

















EXPERIMENTS BEARING UPON THE PRECOGNITION HYPOTHESIS# 
III. Mechanically Selected Cards 


J. B. Rhine 
Parapsychology Laboratory, Department of Psychology, 
Duke University 


ABSTRACT: In an earlier number of this Journal, results 
were reported which led the author to the conclusion that 
subjects could, to some extent, predict card order in 
decks that were later shuffled by the experimenter. 

This was not concluded to be evidence of precognitive 
ESP since, as it was later shown, the deck might have 
been shuffled with some apparent guidance from ESP abil- 
ity--the ESP shuffle effect--and thet this might ac- 
count for the earlier results. The present report deals 
with tests based on mechanical selection of cards, se- 
lection in which the ESP shuffle could have played no 
part. 


Herein are described the procedure, results, and 
evaluation of 1,608 runs through the 25-card deck, under 
conditions called Precognitive Matching. In this tech- 
nique the subject matches the cards of a deck against 
five blank spaces in which there are to be placed, later, 
five key cards mechanically selected by a fixed proce- 
dure. By eight different standard measures for evaluat- 
t the results, they are extra-chance in character. 

All the known and relevant ways of explaining the re- 
sults are then considered but are found inapplicable. 
While the desirability of further evidence is empha- 
sized, no alternative at present acceptable is found to 
the hypothesis of precognition; that is, the ability to 
respond as if to cognition of events (card-orders) not 
yet in existence and not rationally inferable or volun- 
tarily produceable. The effect of rewards, grouping 

of ot, agg and certain ather conditions are experi- 
mentally investigated and discussed. An appendix is 
added giving «a summary of results of all precognition 
tests to June, 1939, and a supplement to this brings 
the summary up to October, 1940. 





1. Mr. Edmond P. Gibson, Record Librarian of the Parapsychology 
Laboratory, has participated as assistant experimenter through- 
out the experimentation herein reported. The extent and manner 
of this participation is explained in the text. He has also 
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Introduction 


In the fall of 1933, experimenters in the 
Parapsychology Laboratory of Duke University, having 
found that distance between percipients and events per- 
ceived did not interfere with extra-sensory perception, 
undertook to ascertain whether "distance" in time would 
do so. The first report of this study was issued by the 
present writer in 1938 and in it were summarized the 
total results, 113,075 trials in pre-shuffle card-call- 
ing tests in which the shuffling was done by hand, made 
by 49 subjects with the collaboration of a number of 
experimenters. These trials gave a positive total de- 
viation of 614 hits (average score per run, 5.14) which 
gives a significant critical ratio (4.5). 


The procedure followed throughout the series 
under discussion consisted essentially in having the 
percipient call aloud or write down a run of 25 ESP 
symbols, intending them as predictions of the order 
which a specified pack of cards of equal number would 
have after it had later on been shuffled or cut in a 
specified manner by the experimenter. 


The alternative hypotheses to ESP that were 
being actively considered at that time were regarded 
as met by the conditions: (1) The results were sta- 
tistically significant and the chance hypothesis was 
excluded; (2) sensory cues could not have aided the sub- 
ject in making his calls since the order of the cards 
did not exist at the time; (3) the selection hypothesis 
was excluded by the completeness of the reporting, which 
included all trials and scores made under the conditions 
described. 


There was, however, angnther hypothesis alterna- 
tive to precognition raised in this Laboratory as a re- 
sult of some related experiments. This was called the 





(Footnote continued) prepared most of the tables, with the in- 
dependent checking either or Miss Esther May Bond or myself. In 
addition to these contributions, I am indebted to Mr. Gibson and 
Miss Bond for conducting and rechecking all the analyses and 
computations entering into the report. This large share in the 
experiments and in the report is gratefully acknowledged. 

To Dr. J. A. Greenwood of the Department of Mathematics, to 
Dr. J. G. Pratt and Mr. C. E. Stuart of the Parapsychology Labor- 
atory, and to my wife, Dr. L. E. Rhine, I am indebted for care- 
ful readings of the manuscript in the course of preparation and 
for help suggestions made. 
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FSP shuffle hypothesis. It implied that the investigator 
shuffling the pack of cards may conceivably have been 
guided to some extent in the shuffling and cutting by ESP 
awareness of the order of the cards and of the subject's 
record. Since the score average was low (5.14), the 
placing of an occasional card by some other method than 
chance would suffice to provide the results obtained in 
the pre-shuffle card collie work, 


The ESP shuffle hypothesis had itself been under 
investigation here for a number of years when the first 
report on the subject was made by Smith, Woodruff and 
myself in the June, 1938, number of the Journal of Para- 
psychology. At that time, two series of investigations 
totalling 211,520 single trials were reported, giving a 
deviation beyond chance of 1,959 (average score per run, 
5.23) which has a critical ratio of 10.4. In this gen- 
eral investigation of the ESP shuffle hypothesis, the 
procedure involved mainly the shuffling or cutting of 
the pack of cards with a view to making it match, in a 
better than chance degree, the order of another pack, 
(or a record of 25 symbols) designated as the target. 

In 68,200 trials of the total, the deck to be matched 
was completely screened from the subject's vision. The 
critical ratio of the deviation of 494 hits (average 
score 5.18) in this more safeguarded block of data 
alone was 4.6. 


So far as the averages were concerned, it was 
clear from the work on the ESP shuffle hypothesis that 
results could be obtained by that method which were as 
good as and even better than those reported for pre- 
shuffle card calling. The conditions of the latter ex- 
periment were in every respect equal to those of the 
earlier report. There was still no evidence that the 
ESP shuffle hypothesis was necessarily the explanation 
of the pre-shuffle-card-calling test results, but it 
appears to be a clear possibility. Further investiga- 
tion was evidently required before the precognition hypo- 
thesis could be brought to crucial examination. The 
step required would have to involve the elimination of 
the possibility of ghey the cards by means of the 
ESP shuffle to meet the predictions of the subject. 


Mechanical Selection Background 


The required step was taken in 1934, when at- 
tempts were made to transfer the shuffling of the cards 


. entirely to mechanical devices and thus eliminate the 


possible personal factor of the ESP shuffle. 
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Considerable difficulty was encountered in the devel- 
opment of suitable mechanical shufflers and in finding 
suitable card materials adapted to the shuffler. Final- 
ly, however, this was overcome to the degree that sys- 
tematic investigation of the precognition hypothesis 
with the aid of mechanical selection of the card order 
of the targets was undertaken. In a large portion of 
this work, the earlier procedure was followed with the 
exception of the manner of shuffling; that is, it was 
still pre-shuffle card eer The designated deck 
would then be put in the shuffling machine, given the 
prescribed number of revolutions, removed, recorded and 
checked for correspondences with the subject's predic- 
tions. 


In other lengthy series, the procedure desig- 
nated as Precognitive Matching was followed. A deck 
of cards was matched by the subject against five blank 
spaces on the table in which later five selected key 
cards would be placed. The subject attempted to place 
each card opposite the space that would later contain 
that one of the five key cards to which he thought it 
would be similar. The key cards were taken in a pre- 
scribed manner from a mechanically shuffled deck, the 
shuffling having been begun after the subject had laid 
the last card on the table. In placing the 25 cards of 
the pack opposite the 5 spaces intended for the key 
cards, the subject was in effect attempting to predict 
what the key cards would be. The random factor was in- 
troduced by the shuffling machine and if extra-chance 
coincidences resulted, the precognition hypothesis (that 
reliable responses may be made to a future random order 
of events) would presumably be supported. (See below 
under "General Conditions and Procedures" for further 
details of this technique.) 


In place of the shuffling machine which direct- 
ly shuffled the cards, other methods of introducing the 
random element were used to a considerable extent. For 
example, a number of dice were thrown from a cup to de- 
termine the point at which the target deck of cards was 
to be cut. In another method the totals of the faces 
of dice similarly thrown were taken to indicate one of 
a number of envelopes, each a a set of ke 
cards to be used in precognitive matching tests. The 
particular envelope selected was one from a large number 
containing randomly distributed keys; the throw of the 
dice made the selection of the particular envelope it- 
self a random one. 
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In another series the dice were thrown mechan- 
ically, and in still others such devices were used for 
cutting target decks of cards (against which predictions 
of the subject were directed) as the use of figures to 
appear in the newspaper on a day specified in advance-- 
e.g-, those given by the maximum and minimum tempera- 
ture, or the last five digits on the right for the total 
stock sales for a given market. 


During the intervening years since the first at- 
tack was made on the precognition hypothesis with a view 
to escaping the application of the ESP shuffle hypothe- 
sis, these methods and minor modifications of them have 
all been used in one series or another of ESP experi- 
ments. But as those who have followed the developments 
of the ESP research field are well aware, advances in 
precautions have continued to be made from time to time 
in the ESP test procedures and as a consequence much of 
the work done with the procedures just mentioned does 
not appear today to meet explicitly all of the most re- 
cently advanced possible counter hypotheses. It does 
not, for example, equal in safeguarding conditions the 
most recent work represented by the report from this 
Laboratory of Pratt and Woodruff in a recent number of 
this Journal. This is not to say that it does not re- 
present evidence on the question of precognition, and 
evidence that must be taken seriously; probably all of 
it will be found to have made some contribution to the 
answering of the question, but in view of the enormous 
amount of work involved in the re-checking, cross-check- 
ing, and — of various analyses that would be ex- 
pected in a full utilization of this material, it does 
not seem at this time a wise expenditure of energy to 
attempt a full report--not, at least, until more recent 
evidence obtained under the most up-to-date conditions 
has determined whether the question as a whole warrants 
the extended consideration which this evidence might 
afford. (There is, however, provided below in Table 
VI, under the discussion of the question of "Selection 
of Data," a brief summary of all the data acquired up 
to the end of the year in which the work of this report 
was done.) 


In the present report, only that work based on 
mechanical selection of cards which has been conducted 
under the most advanced experimental conditions will be 
included; and of this, only that which was conducted by 
Mr. Gibson and myself. The work of comparable char- 
acter conducted by others is in process of analysis and 
preparation for later reporting.*. The general question 


"Miss Hutchinson's report, as it turns out, preceded this one (see 
the December, 1940, issue) but was written after it; hence the omis- 
sion of other reference to it. 
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of the background of experimental results from which 
the material for this report is taken will be discussed 
fully below. 


Introductory Series 


The research program covered in this article had 
its initiation in two exploratory series. These series 
are of sufficiently different character from the prin- 
cipal work of this report that a separate (though brief) 
account of these introductory series is necessary. The 
grounds for regarding these separately will be clarified 
in the discussion of the question of selection of data. 


Introducto Series A. This series contained 
80 runs (of the total of 160 runs made) that were of the 
precognitive matching type, in which the key cards were 
selected by means of six hand thrown dice. The upturned 
faces of the dice were totalled and the number so found 
was used to indicate which of a number of envelopes con- 
taining random distributions of key cards was to be used 
for a given run. The point of interest in this work 
lies in the fact that although the non-precognitive part 
of the series gave a positive deviation, the precognitive 
section was a negative deviation. This negative devia- 
tion was small, -12 for the entire 80 runs (average 
score, 4.85), and was of course insignificant. 


But, small though the deviation was, it seemed 
worthwhile to continue the experiment with a view to 
ascertaining if there were associated with the particu- 
lar type of test (i.e., precognition) some score-depres- 
sant factor. (This interest was furthered considerably 
by the negative deviation which I had just reported in 
connection with the enclosed card tests in which there 
had been delayed checking (7). It was realized, too, 
that a consistent negative deviation would serve quite 
as well as a positive one as a means of exploring the 
hypothesis of precognition and might be more practical- 
ly and repeatedly obtainable. 


Introducto Series B. The next experiment was 
accordingly Tageed to consist entirely of precognition 
tests with the hope of accentuating the hypothetical 
score-depressant factor. Four hundred runs were planned 
in all, and the procedure was that of the precognition 
tests in the preceding series (A). The principal fact 
is that the series as a whole likewise gave a negative 
deviation of -23 (Average score, 4.94). 








“ 
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It seemed warranted again that this experimenta- 
tion be continued under essentially the same general con- 
ditions. There had been introduced, during the series, 
the offer of small rewards, such as movie tickets, for 
the achievement of certain scores. This practice made 
the tests much more interesting to the subjects and was 
adopted as one of the conditions for the projected 
series. 





FIGURE 1a. THE APPARATUS USED FOR THE SELECTION OF KEY CARDS 


On the extreme left is the rotating dice machine, driven 
by motor. Next is the large tray with four small trays, one 
for each set of key cards. At the right is the motor-driven 
shuffling machine. The cards are placed in one end of the 
long box at the top which, in its rotation, throws the cards 
over wavy surfaces within and thus shuffles them. On the ex-— 
treme right is the box of opaque envelopes containing sets of 
key cards for selection by the dice machine. 


The Mechanical Selection Experiments 


The experiments with which this report is 
directly concerned consist of two divisions which will 
be called the Adult Division and the Child Division. 
Each of these consists of several series which will be 
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numbered in chronological order. The four series of 

the Adult Division experiments are those which grew out 
of the interest in the hypothetical score-depressant fac- 
tor suggested by the introductory experiments described 
above. The three series of the Child Division were in- 
troduced as a comparative study, a control on the factor 
in question, and were carried along as a parallel in- 
vestigation. The difference (besides age of subject) 
between the two divisions lay in the expectation regard- 
ing the hypothetical depressant factor. 





FIGURE 1b. MOTOR—DRIVEN, ROTATING DICE MACHINE. 


Adult Division. For the particular group of 
adult subjects who had been used in the Introductory 
Series (and who were to be used, as far as possible, in 
subsequent series), there seemed to exist some ground for 
expectation of a negative deviation. Earlier ESP re- 
search had revealed instances of prolonged scoring below 
chance expectation. The student of ESP is therefore not 
unprepared for this effect. I had, myself, reported ex- 
periments in which subjects had deliberately produced 
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negative deviations (8), and other experiments in which, 
even with apparent effort at scoring above chance, nega- 
tive deviations were nevertheless produced (7, 8). Pe- 
gram (5) confirmed the fact of voluntary control in pro- 
ducing positive and negative deviations at will. 


Child Division. There was no such ground (from 
earlier experiments), however, to expect such a score- 
depressant factor to operate in the instance of child 
subjects. It had not been reported previously as occur- 
ring in tests with children and as a further guide on the 
question, I had the unpublished results of an incomplete 
series conducted by my wife, Dr. L. E. Rhine, which showed 
positive results [282 runs with a positive deviation of 
57 (average score, 5.20)) in tests of children with pre- 
cognitive matching oy small rewards such as were used 
in Introductory Series B. Therefore it seemed advisable 
to run parallel series, using subjects who gave the earli- 
er results of both types as far as possible. 


General Conditions and Procedures 


Since identical objective conditions and proce- 
dures were to be followed both for the Adult and Child 
Divisions, the same description will do for both. The 
Adult Division consists of four series and the Child Di- 
vision of three, a difference due to difference in nua- 
ber of subjects participating. 


Experimenters. Two experimenters were present 
on every occasion and during two series a third observer 
was added for a purpose to be specified below. I, myself, 
was present throughout all series except for rare and 
momentary absences to take telephone calls, during which 
time my secretary, Miss Marion Barber, who is thoroughly 
familiar with the procedures and requirements, substi- 
tuted for me. Mr. E.P. Gibson, Record Librarian of the 
Laboratory, was assistant experimenter in all series with 
the exception of an occasional run or short series of 
runs, during which time a member of the experimental 
staff of the Laboratory took his place. When a third ob- 
server was needed, either Miss Barber or Mrs. Dorothy H. 
Clark, general secretary to the Laboratory, served in 
that capacity. The responsibilities of the different ex- 
perimenters were so distributed that no one individual 
could accidentally or with motivation affect the results 
in favor of any hypothesis except that of chance. The 
specific tasks and responsibilities of each experimenter 
will be described. 





2. A diagram of the general plan of the experiments is given in 
Figure 3. 
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Programs filed in advance. According to the 
rule of the Laboratory, an outline of the research pro- 
gram was filed in advance of the research, one copy go- 
ing to the Record Librarian and the other filed in the 
experimenter's record book. This advance statement 
set the length of each series, stated the procedure and 
conditions to be followed and outlined the safeguards to 
be emphasized. 





The subjects. As far as possible, the subjects 
used were the same as those who had given the results in 
the previous series upon which these experiments were 
based. The 19 subjects used in the Adult Division had 
either been used in the earlier series (Introductory 
Series A and B) or were transient subjects used in one 
experimental session only. There was no serious effort 
made at selection of subjects other than to give major 
emphasis to the group previously tested. These subjects, 
as it happened, were also most convenient to obtain, 
since they were mainly associated with the Laboratory 
staff. Most of the other subjects were introduced in a 
session given over to demonstration of the procedure to 
a visiting group. Five of the child subjects used 
earlier by Dr. L. E. Rhine did all of the work in the 
Child Division. Four of these were children of staff 
members and were selected because of their ready avail- 
ability for repeated testing. 


Test materials. The commercial ESP test cards 
in packs of 25 were used throughout. Decks were counted 
from time to time--in certain series at the end of each 
run--making sure of the number of cards in the deck. As 
soon as decks showed any a? effects from use, they 
were replaced with new cards. n view of the nature of 
the tests, the defect in the printing of these cards 
ee no basis for concern and no screening was 
needed. 





For the shuffling of the key cards, a shuffling 
machine of the type described by Smith (12) was used 
throughout the series. For the throwing of the dice 
used in determining the selection of the key cards (see 
below) a motor-driven, rotating dice cage was used. 

This apparatus, together with the trays used for holding 
the key cards and the opaque envelopes, are illustrated 
(see Figure 1a). 


Leboratory arrangement. Two rooms of the Para- 

psychology Laboratory were used throughout the work here 
reported. The rooms are adjoining, but are separated by 
two brick walls which are themselves separated by an air 
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space. There is no connecting door. An electric buzzer 
connects the two rooms, peseegg Was experimenter work- 
ing with the subjects in room 3B-b (See floor plan in 
Figure 2a) to eee the second experimenter (Mr. Edmond 
P. Gibson, hereinafter referred to as E.P.G.) when the 
subjects had completed a given run. The buzzer was used 
only for that purpose. It will be seen from the diagram 
that the experimental room contains a long table. It was 
this upon which the card matching was done. Places for 
four sets of key cards were indicated down the center 
line of the table by sets of blank face cards permanently 
fastened to the coarse black cloth table cover. A maxi- 
num of eight subjects could work at one time if desired. 
The shuffling and dice throwing machines, as well as all 
cards from which the selection of keys was made, were in 
the adjoining room, 3K-d. During the experimental ses- 
sions, the doors of room 3B-b were kept closed and there 
was no communication between the two rooms, with the ex- 
ception of the one-way signalling mentioned above. 









































FIGURE 2a. FLOOR PLAN OF ROOM IN WHICH THE EXPERIMENTS WERE CONDUCTED. 


3B—b is the test-room. All the tests were conducted on the long 
table indicated. 3K-d was the location of the card selection machines. 
They were on the table shown. The doors 3B and 3K were left open but 
those of 3B-b were kept closed. 
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FIGURE 2b. EXPERIMENTAL TABLE AT THE CHECKING STAGE. 


Key cards (four sets of five each) are in the center. Eight 
decks of cards have been matched, two against each set of key cards. 
Four subjects and two experimenters are present. 


Procedures. At the beginning of the experiment- 
al session both machines were turned on, the shuffling 
machine containing a pack of 50 ESP cards, the dice 
machine containing 6 dice 3/8 inches in size, of common 
commercial variety. The shuffling machine made four re- 
volutions per minute and the dice machine, six. Figures 
on the rate of rearrangement of cards by a shuffling 
machine of the type used were given by Smith; the dice, 
rolling over the wire mesh sides and baffles of the cage, 
obviously received an adequate amount of disturbance. 
The length of the cage was 15 inches; the size of the 
mesh, ¢ inch on one side and 1/12 inch on the other. 





In the experimental room, the subjects were told 
the nature of the test if they did not already understand 
it. They were asked to match the decks of cards given 
them against the five blank cards on the table before 
them; i.e., to try to place each card so that it would 
match the key card that would be placed on that space 
after the run. They were not told whether the key cards 
for that particular position would be selected by the 
mechanical shuffler or by the dice throwing machine, but 
they knew that it would be by one or the other method. 
After receiving an explanation of the system of reward 
for high scores, they were told to proceed to deal out 
the cards, keeping them in the inverted position. 
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In view of the fact that there were at the time 
no key cards in place and the further circumstance that 
the key cards were to be selected at random, no special 
effort was made by the experimenter to prevent the sub- 
ject from obtaining cues from the cards; that is, no 
screens were used, no attention given to lighting effects, 
and no special scrutiny given to detect any attempts by 
the subject to turn the cards so as to see their faces. 
The possibility of such effects entering into the experi- 
ment were fully in mind, but it was recognized that the 
expected score average could not be influenced in that 
way. If sensory cues from the cards influenced the sub- 
ject in placing them, there might, it was realized, re- 
sult an altered distribution of scores; but if such were 
the case, the statistical analyses of the results would 
reveal the effect and distinguish it from score distri- 
butions resulting from ESP matching (see below under 
"Stacking Effects"). 


Likewise, little attention was given to elabo- 
rate shuffling of the decks of cards used by the subjects, 
except with the introduction of new decks. After a deck 
of cards had been distributed and the run finished, the 
deck was considerably mixed up as it was assembled from 
its spread-out position on the table. This mixing up 
was especially effective since each card lay in an iso- 
lated position at the start. After the cards had been 
gathered up and inverted, they were frequently turned 
over to the subject without a cut or further shuffle. 
The same considerations of safety, however, enter here 
as in the paragraph just preceding. 


If only one subject was present, he was asked to 
match eight decks at a single round. The number of sub- 
jects working at a time varied from one to eight. If 
only two were working, effort was made to prevent them 
from working opposite each other at the same time be- 
cause of the possible distracting effect of the responses 
of one upon the other. As soon as all the decks were 
placed or matched, the buzzer signal was given to the se- 
cond experimenter, E.P.G., who at once stopped both 
machines. In the experimental room, the first experiment- 
er, J.B.R., with the aid of the subjects, turned the 
matched cards face upward, laying them out so that they 
could be easily identified. Toward this end, cards of 
the same smybol opposite a given key space were grouped-- 
i.@., placed side by side. This experimenter, in all but 
two of the seven series, then proceeded to make records 
of the card order on consecutively numbered record sheets 
issued specifically for the particular experiment and 
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stamped with the seal of the Laboratory. These records 
(made in ink) had to be completed before the opening of 
the door to admit the second experimenter, E.P.G., with 
the key cards. 


Experimenter E.P.G., after stopping the machine, 
opened the shuffling machine, removed the deck of cards 
(if any cards were out of place, they were picked up as 
they lay and placed on top of the deck). The top card 
of the face down pack was taken to be the key card for 
space No. 1 for the first set of spaces at the west end 
of the table used in the tests; the next card down of 
different suit, for key card No. 2; the third card of 
different suit, for space No. 3, etc., until the five key 
cards were obtained for the first set of spaces. When 
the first set of key cards was made up, the next card in 
the mechanically shuffled deck was taken as the first key 
card for the next set, going eastward on the table. The 
next following card of different suit was taken for the 
second key card, and so on until the second set was con- 
pleted. Thus two sets of key cards were selected from 
the deck of 50 mechanically shuffled cards. 


With the exception of the first few runs made be- 
fore the dice throwing machine was adapted for the pur- 
pose, the other two sets of keys (at the east end of the 
table) were selected as follows: The upturned faces of 
the six dice were totalled by the second experimenter. 
(Special provision was made for instances in which there 
was some irregularity--such as a die being on top of 
another. In that case, another revolution was given.) 
The number arrived at was used to select an opaque en- 
velope from a box (containing 36 or more such envelopes) 
kept in readiness for the purpose with one end identi- 
fied as the front. Beginning at the front, the experi- 
menter would count off envelopes until he came to that 
which corresponded to the number obtained from the dice. 
This envelope contained five key cards and these were 
taken from the envelope in a prescribed manner; the top 
card, when the envelope was held so that the keys were 
face down, became the first key card for position No. 3 
from the west end of the table, and the other cards of 
the envelope followed in sequence. The envelope immedi- 
ately following the first one selected provided in like 
manner the key cards for the fourth position (set of 
spaces). The key cards had been selected and shuffled 
before placing them in the envelopes by E.P.G. and an 
assistant, working together to check against error. A 
large stock of these envelopes was prepared and kept in 
reserve, the box being replenished as needed. As a set 
of key cards was used it was reshuffled, returned to its 
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envelope, and this was stored with a stock of 200 such 
envelopes from which the needed supply was drawn. In the 
shuffling of the key cards for use with the dice selec- 
tion method, no special criterion or set of precautions 
was introduced in view of the fact that not only do other 
random factors enter into the final production of scores 
but an eventual check-up can be made statistically which 
will determine whether any error could have been intro- 
duced from this source (see the cross-check results). 


Four trays, each having five shallow boxes, were 
used for the key cards; each was numbered and each had 
its proper east-west orientation indicated in order that 
reversal of orientation could be detected at once if it 
occurred. The key cards were placed face upward in the 
boxes of the trays immediately upon their selection. The 
key cards were recorded in ink on comparable numbered and 
stamped record sheets. Immediately following the comple- 
tion of the selection and the completion of the recording 
of the key cards by E.P.G., the four trays were carried 
on a large tray to the experimental room. On entering 
the experimental room (after the recording in there was 
completed) E.P.G. immediately put the trays with the key 
cards in their appropriate spaces. Experimenter J.B.R. 
recorded on the same record sheet on which the target 
decks were recorded, the appropriate set of key cards 
against which they were to be matched. He then checked 
the record immediately and determined the score for each 
deck. Meanwhile, experimenter E.P.G., retaining his own 
record of the key cards, proceeded to check the number of 
hits in each target deck, checking directly from the 
cards. He recorded his scores and checked these against 
the corresponding scores of the other experimenter. The 
subjects also invariably made an independent count. If 
there was any discrepancy, the cards and the records were 
immediately consulted. The recording techniques were 
definitely directed toward rendering the scoring by the 
two experimenters independent. 


J.B.R. then transferred his scores to his per- 
sonal record book to be kept in his possession until the 
end of the series. After that he turned over to E.P.G. 
his record of the key and target cards on which his 
scores were recorded. Thus there was not only recording 
of key and target cards before the two were brought into 
the same room, but independent ee one from the re- 
cords and one from the cards; and finally, also, there 
were independent records of all scores retained by the 
two experimenters. In the event of any later discrepancy 
or evidence of error found in the handling of the records, 
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the rule was laid down that the score nearer the chance 
mean should be taken. Throughout the period of checking, 
from the point at which the key cards were brought into 
the experimental room, experimenters and subjects were re- 
quired to refrain from touching the cards on the table. 


During two of the seven experimental series, in 
order to speed up the procedure, the recording of the two 
sets of cards--key and target cards--was eliminated and a 
third observer was introduced; thus a triple count of the 
card coincidences could be made directly from the table. 
The two regular experimenters each made his independent 
count and recorded the scores immediately in his record 
book, checking with each other at the end of the count. 
The third counter made a record of the number of hits in 
each column of cards opposite the key cards. These were 
then totalled from the five columns for each run to get the 
score. This was then checked with the other two experi- 
menters. In the presentation of the results, the two 
series having the triple count instead of detailed record- 
ing will, of course, be indicated and full comparison of 
results made possible. 


Special precautions. Most of the special precau- 
tions have been mentioned, but they will bear reviewing. 
In order to avoid the possibility of loss or exclusion of 
any record, consecutively numbered record sheets were used 
throughout and a record of these was kept by the Record 
Librarian at the time of their issue. In five of the seven 
series, independent records of the two sets of cards to be 
matched were made before the two sets of cards ~2re brought 
together, and in the exceptions triple and ind cndent 
counting was substituted. Frequent checks were made on the 
number of cards and the composition of the decks which were 
used. Independent score records were kept by the experi- 
menters throughout the series. Comparisons of scores were 
made immediately following checking and if any discrepancy 
occurred, it was immediately cleared up. The card records 
were re-checked at the completion of the series and in the 
event of discrepancy with the score records kept by the ex- 
aeons, the score favoring the chance hypothesis was 
aken. 


Experimental atmosphere. No one in the adult 
series was told, and it seems safe to conclude that no one 
discovered during the period of the experiments here report- 
ed, that the series of experiments was planned to test the 
hypothetical score-depressant factor--that is, that nega- 
tive deviations were being sought. As nearly as possible, 
the general social situation was the same as that which had 
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obtained in the Introductory Series A and B. In view of 
the fact that one possible hypothesis to account for the 
negative deviation depended upon a critical or doubtful at- 
titude on the part of the subject toward the precognition 
hypothesis, no effort was made to render this hypothesis 
(precognition) plausible--that is, if the adult subject 
possessed doubt about the possibility of precognition, that 
mental state was not disturbed. This preservation of at- 
titudes is difficult, and there is no measure of the suc- 
cess actually attained. It can only be said that whereas 
with the child subjects considerable thought and attention 
were given to making the tests as interesting and plausible 
as possible, little was done in this direction with the 
adults. On the other hand, nothing was deliberately done 
to annoy or disturb the subjects nor to increase their 
scepticism about precognition. The aim was to maintain the 
status quo. 


Group effects. No hard and fast rule was laid down 
regarding the number of subjects that would be allowed to 
participate at a time. At first it was customary to allow 
one subject to work at a time. Later they were allowed to 
work in pairs, and still later the adults were allowed to 
work in groups. Most subjects enjoyed working in pairs and 
evidently enjoyed still more working with a greater number 
participating at a time. As the effect of greater numbers 
was observed, this way of working became more popular with 
the - ae as well. (See below "Group test effects, 
etc." 





Reward vs. no-reward series. In order to test the 
impression given in Introductory Series B that offering re- 
wards for high scores might have accentuated the negative 
deviation during the latter part of that series, it was 
decided to divide each experimental round on the table into 
a reward and a non-reward half. That is, four runs on one 
side of the table were to be subject to the reward schedule 
and the four runs on the opposite side were to be unreward- 
ed. (In order to remind the subjects of these differences, 
since some of them tended to forget it, signs were put on 
the table to indicate which runs were for reward.) This 
arrangement was continued through five of the seven series. 





No-reward controls. But because of the ambiguity 
of the results in the reward vs. no-reward comparison, it 
was found necessary also to conduct control series consist- 
ing entirely of non-reward tests for each of the two Divi- 
sions. In this part of the experiment, it was explained 
to the subjects at the start that no rewards would be given 
on either side of the table, no matter what the scores 
turned out to be. 
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Nature of rewards offered. In the first few runs 
of the first series, the rewards were small, consisting of 
candy and movie tickets. A schedule of money rewards was 
then introduced according to the following schedule: 





Score Reward 
10 $ .50 
11-12 1.00 
13-14 5.00 
15-17 10.00 
18-22 25.00 
29-25 100.00 


In addition, small rewards in the form of candy bars were 
given for scores of 8 and 9. Subjects were informed of the 
reward schedule in advance of the test and were promptly 
given their winnings as they were earned. 


Evaluative Methods 


For the computation of the probability of the oc- 
currence of the deviations obtained--that is, deviations 
from the theoretical mean chance expectation--the critical 
ratio method based on the standard deviation of the binomi- 
al (/npq) has been used throughout. In addition, the crit- 
ical ratio has been obtained from the empirically deter- 
mined standard deviation. The critical ratio of the dif- 
ference between Child and Adult Divisions has likewise been 
obtained, using both the theoretical and the empirical 
standard deviations. Further, the chi-square values of 
score frequency distribution have been determined for each 
of the two large divisions. Also, the combination of crit- 
ical ratios of sub-series by a chi-square procedure (11: p. 
386) is followed in evaluating the results. The contin- 
gency method would vannamkaaaly represent a further method 
of use in the same end, but in the absence of special need 
and in view of the enormous amount of work involved for so 
large a mass of data, it has not yet been applied in this 
instance. 


Cross-checks were made on five out of the seven 
series--that is, on all upon which written records were 
available. The target series was checked against the cor- 
responding key card of the next succeeding round of runs, 
thus providing an empirical control series, affording a 
basis for (a) determining whether a chance score distribu- 
tion obtains: (b) checking on the question of recurrent 
target card patterns of any se (c) discovering effects 
of possible inadequacy of shuffling; (d) checking on possi- 


ble sensory cues or peeping on the part of the subjects in 
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Figure 3 
DIAGRAM OF THE EXPERIMENT 
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the placing of the target cards; and (e) detecting undue 
occurrence of peculiarities of distribution in the key 
cards. In dealing with some of the problems just mentioned, 
the results from the cross-check are evaluated by critical 
ratio (both theoretical and empirical) and chi-square meth- 
ods. 


Finally, methods are used to deal especially with 
corrections required or suggested in the light or possible 
counter-hypotheses such as the matching hypothesis, stack- 
ing effect, the optional stopping effect, and various se- 
lection hypotheses. All these methods will be further dis- 
cussed in the light of the specific results. 


Experimental Results 


In both Divisions, there were conducted a total of 
40,200 trials or 1,608 runs. Of these, 1,108 runs made up 
the Adult Division, distributed in four series of 200, 200, 
180, and 528 runs respectively. The Child Division con- 
tained 500 runs, made up of three series of 200, 100, and 
200 runs respectively. (See Figure 3.) 


Adult Division. In terms of total deviations for 
the divisions, the 1,108 runs of the Adult Division gave a 
total negative deviation of 239; it was negative as antici- 
pated from the Introductory Series. This is an average de- 
viation per run of -.22, representing an average score of 
4.78. The critical ratio based on the theoretical standard 
deviation is 3.59; and on the empirical, 3.44. The chi- 
square of the fit of the observed frequency to a binomial 
distribution is 34 with 12 degrees of freedom, which is 
equivalent to a probability of .00035. By all three mea- 
sures, the results are significantly different from chance. 





Child Division. The Child Division gave, as was 
anticipated, a positive deviation; it was slightly larger 
in average than the negative one of the Adult Division, 500 
runs yielding 123 hits above the theoretical mean. The 
average deviation of .25 (am average score of 5.25) gives 
a critical ratio of 2.75 by the use of the theoretical 
standard deviation and 2.63 by the empirical. The chi- 
square evaluation of the frequency distribution of the 
scores gives 21 with 10 degrees of freedom, which is equi- 
valent to a probability of .012. These measures, too, are 
regarded as significant, except the last given; this is 
.002 above the criterion. (See Table I). 





Difference between the Divisions. The critical 





ratio of the difference between the means, based upon the 
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observed standard deviations, of the Adult and Child Divi- 
sions is 4.10. The critical ratio of the difference based 
upon the theoretical standard deviation is 4.29. 


In view of these various. significant criteria, the 
operation of extra-chance factors is clearly indicated. 
It is in order, then, to give consideration to other hy- 
potheses--first to those which may be regarded as alter- 
native to the experimental hypothesis under investigation 
(i-e., precognition) and later to hypotheses of positive 
bearing that may be indicated by the results. 


Table I.* 
COMPARISON OF GROSS RESULTS 
ADULT AND CHILD DIVISIONS 


Runs Aver. Total Theor. Emp. Prob. x2 
Dev. Dev. C.R. C.R. Score Freq. 





Adult Division 1108 -.216 -239 3.59 3.44 .00035 
Child Division 500 +.246 +123 2.75 2.63 .012 
Diff. between Adult 

& Child Division 462 4.29 4.10 

Pooled Adult and 

Child Division 1608 -0107 





* The original scores of all series reported on in this paper will be 
furnished interested readers in mimeographed form upon request as 
will be, also, results of all cross—checks. 


3.This pooling ignores the fact that opposite signs of deviation were 
the experimental objectives in these two divisions. This figure 
is given, nevertheless, for whatever interest it may have. If the 
total deviations of the Adult and Child Divisions are pooled regard- 
less of signs, on the ground of there having been opposite sign ob- 
jectives, the total deviation is 362; the theoretical critical 
ratio, 4.51; and the empirical, 4.33. Since each Division is in- 
dependently significant, this pooling adds nothing and is 
included for those who accept the two Divisions as dealing with the 
same basic process. 
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Counting errors. 


Counter Hypotheses 





Of the Adult Division, the 


first three series totalling 580 runs were conducted with 
independent recording; that is, without reliance on the 
triple counting procedure. 
negative deviation of 161 (average score, 4.72) which 
yields a critical ratio of 3.34. 
same critical ratio is given by the empirical method, 
also. Similarly in the Child Division 300 runs were con- 
These gave a positive 


ducted with independent recording. 


(See Table II.) 


These 580 runs gave a total 


The 




















Table II. 
COMPARISON OF ESP SCORES* AND CROSS-CHECK SCORES 
Runs Dev. Theor. Emp. Prob.# Prob. x2 Prob. 
ole 2 xX Score x2-Comb. 
or X (C.R.) Freq. C.R.'s 
Adult Div.: 
Series 1-3 580 -161 3.34 3.34 .00042 .02 - 0068 
Cross Check 
Series 1-3 580 - 62 1.29 1.30 .0985 Be 
Child Div.: 
Series 1-2 300 +98 2.83 2.75 .00233 .03 .018 
Cross Check 
Series 1-2 300 - 69 1.99 2.05 .0233 58 oe 
Diff. Adult — (av. dev.) 
and Child -604 4.25 4.16 .000011 — —_— 
Diff. Cross — (av. dev.) 
Check 123 0.86 0.88 .195 oa ot 











* Only those are included on which cross check data are available: 
Series 1-3 of the Adult Division and Series 1-2 of the Child Divi- 


sion. 


# Multiply these probability values by 2 to make allowance for the 
possibility that had deviation signs not been as experimentally 
anticipated, they would have been recognized (i.e., as other than 1). 


deviation of 98 with a critical ratio of 2.75. 


According- 


ly, the results may be taken either in their entirety, in- 
cluding the triple counting series (i.e., the last series 
in each Division), or without, without seriously altering 
the statistical significance of the report as a whole. 


Errors of recording, computation, clerical work, 





etc. Since recording errors could not under the circun- 
stances of the procedure described above operate to affect 
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the critical ratios obtained, no further consideration 
will be given to errors in this general classification. 
Not only has the clerical work been independently checked, 
but likewise the arithmetical computation. 


Sensory cues. If the subject obtained cues from 
the cards, or for that matter, looked at them outright, 
he could have at most grouped the cards of one symbol on 
one particular key card. This would in the extreme have 
led to the placing of five circles opposite one key card 
space, five squares opposite another, etc. While this 
did not happen in the extreme or it would, of course, have 
been detected at once, there is the possibility that it 
happened to some real but unnoticed extent and that there 
was as a result more grouping of symbols than would have 
occurred by chance, or than was explainable as due to ESP 
ability. To differentiate between such an effect due to 
sensory cues (or other spurious factors) and one due to 
ESP matching of the key cards, it is necessary only to re- 
flect that if the latter is the determinant, it would pre- 
sumably lead to more hits (or to fewer-than-chance hits 
if systematic avoidance occurred)--that is, the groupings 
would be opposite the right key cards in the check-up; 
whereas if due to spurious factors, there would be no 
such grouping except by accident. In that case, the aver- 
age in the long run would not be affected. Such indeed 
is the case as revealed by the comparison of the actual 
deviation of the ESP scores with the deviations obtained 
from the cross-check scores (in which cards were matched 
with key cards they were not intended to match). Both in 
the Adult and Child Divisions and in both methods of eval- 
uation, the critical ratio (both empirical and theoreti- 
cal) and chi-square, in all a total of six separate eval- 
uations, none of the cross-check results were found to be 
significant. Nor for that matter were even the individual 
series themselves, representing, in all, ten independent 
analyses. This is in contrast to the various criteria of 
significance rendered by the ESP results themselves. For 
comparison of ESP scores and cross-check scores, see Table 


The question, however, of whether an effect from 
sensory cues leading to a grouping of cards might not af- 
fect the results even though the average score itself was 
not affected,is a legitimate one. Accidental coincidences 
of grouped symbols would in some instances raise scores 
and in others lower them. Thus an unusual distribution of 
scores might be obtained even though it would average ap- 
proximately five. This might contribute a significant 
chi-square value. The fact, however, that the cross-check 
did not yield significant chi-square values indicates that 
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such grouping, independent of ESP grouping, did not oc- 
cur, at least appreciably, and accordingly the signifi- 
eant chi-square produced by the ESP scores cannot be 


Table III 


SUMMARY OF ALL MECHANICAL SELECTION PRECOGNITION 
Tests Completed to June, 1939.* (Two Experimenters) 








Experimenters Runs Dev. S.D. Theor. y2 Prob. 
eB xX 2 Comb. 
C.R.'s 
Stuart & Pratt 1368 +98 74.0 1.32 1.74 
Crampton & Smith 813 -69 57.0 1.21 1.46 
Rhine & Gibson 
(Adult) 1108 -239 66.6 3.59 12.89 
Rhine & Gibson 
(Child) 500 +123 44.7 2.75 7.56 
Total 3789 23.65 .00009 


* For series incomplete at that time, see Table VI. 


attributed to the hypothesis of grouping due to sensory 
cues, 


It might further be questioned whether the usual 
standard deviation could be properly applied to the re- 
sults if there is a possibility that through sensory cues, 
or other non-experimental factors, the spurious groupings 
in question — have been produced, even on the supposi- 
tion of a purely chance series. But the same evidence 
which met the objection considered in the paragraph above 
applies here likewise--that is, if there is no evidence 
of the supposed grouping attributable to sensory cues 
(and like factors) as is shown by the fact that the empi- 
rical C.R. and the chi-square of the cross-check score- 
distribution are insignificant (See Table II), it indi- 
cates that the departure from the binomial produced by 
the ESP scores was not attributable to unusual groupings 
by such improper factors as sensory cues. 


The stacking effect, card-warping effect, inade- 
uate shuffling hypotheses. The stacking effect is sim- 
ply a name for the general possibility that because of 
one circumstance or another some non-random grouping of 
the target cards might occur, producing a stacking of 
cards of one symbol opposite a given key card space with- 


out the arrangement having had anything to do with pre- 
cognitive ESP ability. Peculiar warping effects of the 
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Table IV 


RESULTS OF THE EXPERIMENTS REPORTED, AS DISTRIBUTED OVER VARIOUS SUBDIVISIONS 



























































Subdivision Method of Reward or Runs Dev. Aver. S.D. C.R. X* or 
Selection No-Reward Dev. CRO 
Adult Div. Shuff. Rew. 50* - 17 
Series 1 Mach. eel 50 - 7 
Few. vs. No-R. Dice = 50 - 10 
Mach. No-R. 50 - 3 
Series Total 200 - 37 185 28.3 1.31 1.72 
Snuff. Rew. 50 - 9 
Series 2 Mach. No-R. 50 - 22 
Rew. vs. No-R. Dice nage 50 - 23 
Mach. No-R. 50 - 23 
Series Total 200 - 77 - 385 ano2 . 2678. - Tehe 
Shuff. ee 5 - 19 
} Series 3 Mach. No-R. 45 ~ 25 
Rew. vs. No-R. Dice oe 45 +12 
Mach. No-R. 45 - 15 
Series Total 180 - 47 -261 26.3 3.75 3.06 
Shuff. iy 132 - li 
Series 4 Mach. No-R. po ee + 27 
No-Reward Dice se 132 - 49 
Control Mach. No-R. 132 - 35 
Series Total 528 - 78 -148 46.0 1.459 2.86 
Adult Division Total 1108 -239 2216 66.6 3.59 12.88 
P(x® = 15.04): = .0046 
Child Div. Shuff. eve 50 + 40 
Series l Mach. No-R. 50 + ll 
Rew. vs. No-R. Dice ome 50 + 1 
Mach. No-R. 50 * 25 
Series Total 200 + 67 0 335 28.3 haat 5.62 
5 Shuff. . 25 + 18 
’ } Series 2 Macn. No-R. 25 ‘ 7 
3 Rew. vs. No-R. Dice er 25 + 6 
aa Mach. No-k. 25 ) 
| Series Total 100 ?o 20.0 1.65 2.40 
> Shuff. ey 50 - 8 
Series 3 Mach. No-R. 50 + 6 
No-Reward Dice Laie 50 + 29 
Control Macn. No-R. 50 - 2 
. Series Total 200 25 125 28.3 0.88 0.77 
Child Division Total 500 123 246 44-7 2.75 7.56 
P(x? = 8.79) =.032 
GRAND TOTAL 1608 


(Combined by Series) P(x? = 23.83) 
(Combined by Div.) P(x? 


-0012 
20.44) = -000037 


ad Groups of Runs in this column also represent columns in the record book and different positions 
) of runs on one side of the experimental table. 
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cards leading to tendencies for certain cards to cling 
together, others to separate more easily, are sometimes 
thought of as possibly contributing to such an effect. 
Inadequacy of shuffling, combined with habits on the part 
of the subject of placing cards in a certain pattern 
might likewise be suspected on superficial consideration 
to contribute to some such result. But from whatever hy- 
pothetical source the case of such grouping may be sup- 
posed to come, including the more plausible source dis- 
cussed above under sensory cues, the methods of checking 
up on the hypothesis would be essentially the same; 
namely, the analysis of the cross-check data. As already 
shown, the evidence from the analyses in the present in- 
stance (and in all earlier work similarly examined) (11: 
p- 43) gives no grounds for this hypothesis. 


Selection of data. Certain aspects of the gener- 
al question of selection of data may be answered easily 























Table V 
EFFECTS OF REWARD UPON PERFORMANCE 
Subdivision Condition Runs Dev. Av. Dev. 
Adult Division 
Series 1 i 100 -27 
No—Reward 100 -10 
Series 2 {comes 100 -32 
No—Reward 100 -45 
Series 3 Reward 90 -7 
No-Reward 90 -40 
Series 1-3 j dat 290 -66 -.23 
No-Reward 290 -95 —. 33 
Totals Reward vs. No—Reward 580 -161 -.28 
Series 4 Control No—Reward 528 -78 -.15 
Child Division 
Series 1 { Reward 100 +41 
No-Reward 100 +26 
Series 2 { Reward 50 +24 
No—Reward 50 +7 
Series 1-2 { Reward 150 +65 +, 43 
No-Reward 150 +33 +,22 
Totals Reward vs. No—Reward 300 +98 +, 33 





Series 4 Control No—Reward 200 +25 +.13 
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and objectively; others may be answered equally objective- 
ly but require elaboration. So far as the selection of 
data through loss, discarding, or deliberate manipulation 
of grouping is concerned, the answer on the records (and 
in duplicate) is that there was none. The series reported 
herein were announced in advance and official record 
sheets provided for the purpose. There are at least two 
independent and complete score records on file for all 

the work described. In resume: from the beginning of 

the investigation herein reported, on December 8, 1938, to 
the end of the series on March 17, 1939, no single score 
has been omitted from experiments of the character de- 
scribed, conducted in this Laboratory. 


The more difficult aspect of the selection hy- 
pothesis concerns the propriety of the presentation of the 
particular group of data which is reported in this paper. 
The principles followed in this instance are those believed 
to be commonly in practice among experimental psycholog- 
ists and experimenters in general. The radical implica- 
tions of the precognition hypothesis, however, make it im- 
perative to consider afresh all such principles and to 
take note of any possibly unsafe assumptions that may be 
involved. 


First, it is general practice for an investigator 
in any field to regard his own work as an adequate sample 
for separate statistical treatment and to evaluate it in- 
dependently of any similar work produced by others. Se- 
cond, it is likewise common procedure that a given set of 
conditions be sufficient criteria for the delimitation of 
a sample of statistical data. If the sample treated is 
representative of the work done under the specified con- 
ditions, work done under other conditions, however small 
the difference, may be excluded from the evaluation so 
long as there is any possibility that the difference in 
condition might conceivably contribute to determination of 
the results. Third, there is commonly no question raised 
over the policy of the experimenter in deciding upon the 
point at which he issues a report of results--that is, 
the stopping point, temporary or otherwise, in the general 
exploration which he is undertaking. Aside from certain 
niceties expected in the way of rounding out a series of 
"sufficient length" there are no fixed standards of proce- 
dure governing the termination of a research program. 

The research may be mapped off in blocks or units of spec- 
ified length, but whether or not the units adopted will 
be repeated at a given point in the series is generally 
left without question to the judgment of the experimenter. 
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But in view of the special concern over methodology 
in this research, special consideration will be given to 
the justification of the selection made in this case. The 
first question might be put as follows: On what grounds 
do I restrict the report to cover my own work and exclude 
from present consideration work of comparable character by 
other investigators? The answer is that in this instance, 
as with most psychological experiments in which the exper- 
imenter is part of the environment, the work by a given 
experimenter may very well involve a difference in en- 
vironmental determinants of the results. It is important 
in the very interest of comparison of experimenters to 
have the work of a given experimenter separately treated 
and presented. There is, however, a secondary considera- 
tion which should be kept in view at the same time; name- 
ly that if there are a number of experimenters using con- 
parable conditions in the investigation of a given hypo- 
thesis, the general results have a bearing--that is, if 
a probability is found for the results obtained by one of 
the several experimenters, it is relevant to take note of 
the number who have been making the attempt. A corrective 
nee ga such a situation is well known [i.e., p'=1- 

1-p * 


It would appear simple enough to apply the correc- 
tive factor just mentioned to the case in hand if everyone 
were to agree as to just what would constitute effectively 
similar procedures. Making liberal allowance and over- 
looking differences that might well justify discrimination 
(e.g., very different types of subjects were used), the 
work of two other experimental series completed but as 
yet unpublished (one undergoing analysis for early publi- 
cation) might be regarded as comparable and included in 
the evaluation. I refer to research on precognitive 
matching conducted during the same year by Mr. C.E. 

Stuart and Dr. J.G. Pratt of this Laboratory, using the 
mechanical shuffler, and to that of Mr. Burke M. Smith and 
Miss Barbara Crampton, using a similar procedure. The re- 
sults of these two series are given in summary form in 
Table III, along with the results of the two divisions 

of the present report and a critical ratio is presented 
for each, with a combination of these critical ratios by 
a chi-square method suggested for this purpose by Green- 
wood. It will be seen that while neither of the other 

two series produces a significant critical ratio*, they 





4. It should be mentioned that the forthcoming report of the re- 
search by Stuart and Pratt will show that in spite of the insig- 
nificant critical ratio important relations have been found upon 
closer analysis. 
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do not affect the significance of the results of the three 
groups of research taken as a whole. (p = .00009) 


The next question that arises is: Are the grounds 
adequate for restricting this report to work with mechan- 
ical selection of cards? In my previous report, I gave 
a complete account of the research on pre-shuffle card 
calling in which the shuffling was manual. It was later 


‘pointed out that another method of shuffling was called 


for to eliminate the possibility of the ESP shuffle (10). 
It is necessary, then, to separate the mechanical selec- 
tion work from the earlier report. However, other meth- 
ods of selection have been used; for example, the tests 
with the use of hand thrown dice mentioned in the Intro- 
ductory Series A and B. Later work has been done with 
the method of rearranging the cards involving specified 
sets of numbers to be obtained from a newspaper of speci- 
fied future date. These differences in determining the 
card order are sufficiently great to warrant separate 
treatment of the results. However, if there be any dis- 
position to question the propriety of this separate treat- 
ment, chi-square combination of the critical ratios is 
again possible. Table VI provides the chi-square in ques- 
tion. It will be seen that the data are there assembled 
from a considerable variety of conditions and the criti- 
cal ratios of the different groupings are combined so as 
to show the effect of grouping upon the estimate of the 
probability of the occurrence of the C.R.'s. The proba- 
bility is 10~- . 


A similar question might be raised with regard to 
the restriction of the research herein reported to that 
conducted with two or more experimenters present, each 
furnishing a check upon the other. In answer to this, it 
would have to be said that such a separate treatment as 
the present report affords would, as a matter of fact, be 
— by most investigators in the field at the present 

ime. 


The chi-square method of combining critical ratios 
is advantageous in the evaluation of this work as a whole 
in view of the varied conditions; e.g., some researches 





5. The special question might occur as to the ground for excluding 
the Introductory Series A and B. The reasons are, in brief, that 
the procedures and conditions were quite different from the Child 
and Adult Divisions. To cite only one difference: the selection 
of cards was all done with dice, and these were all hand-throwm. 
Mechanical selection did not occur in either series. But if these 
series (A and B) were pooled with the Adult Division, the C.R. 
would still be of almost equal significance: 3.43 as against 3.59. 
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eg 


were conducted with the express goal of obtaining nega- 
tive deviations, as in the case of the Adult Division of 
the work reported above. The work done in the correspond- 
ence tests for precognition is likewise negative. How- 
ever, the use of the chi-square combination method re- 
ferred to above makes allowance for the possibility of de- > 
viation in either direction in every series. 


The principal question remaining for discussion 
under the selection hypothesis is that dealing with the 
legitimate determination of the stopping point. As Green- 
wood has pointed out (4), practically every statistical 
report potentially involves optional stopping. There is 
no way known as yet to insure with finality against some 
option as to whether the experimenter will continue or 
will stop (e.g., to make a report). He may, as was done 
in the work herein reported, state at the outset that he 
will do a stated number of runs. When that is through he 
may repeat and again the same possibility is left. Stat- 
ing in advance that he will not repeat nor continue under 
any circumstances or with any variation would, of course, 
remain a possible solution and would reduce the question 
to one only of the ethics of the experimenter in adhering 
to his own self-limitation. Since, however, no experi- 
menter probably wishes to commit himself against further 
investigation, the corrections arrived at by Greenwood 
offer the best measure at present available of security 
against possibility of error on that score in the inter- 
pretation of results. This correction represents an up- 
per limit. When the Greenwood correction is applied to , 
the probability obtained from the maximum critical ratio 
produced by the work reported in this paper, it is in- 
creased from -000,058 to 000,464 and still remains sig- 
nificant. 








From the point of view of practical empirical ob- 
servation, the optional stopping hypothesis stands upon a 
very weak case in any event. In Greenwood's entire series 
of 500,000 matchings of cards against calls he examined 
the possibilities of finding a favorable point of stopping 
and found in the entire series no point with a critical 
ratio of the cumulative deviation as great as that ob- 
tained in the present series. Optional stopping, then, 
while theoretically important, is here soantieatiy of min- 
imal concern. 





6. I am indebted to Dr. Greenwood for this computation. His method 
of determining this upper bound is in the course of preparation 
for publication. 
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There is a consistency of trend to the deviations 
in both the Child and Adult series that is of considerable 
reassurance also against the hypothesis that the favorable 
deviation critical ratios might be due simply to finding 
favorable stopping points. As may be seen from inspection 
of Table IV, the natural grouping of the results gives 
predominantly negative deviations for the Adult Division 
and predominantly positive deviations for the Child. In 
23 of the 28 logical sub-divisions, the deviation is that 
which would have been experimentally anticipated. The 
probability of this occurring in a chance series is .000,467 
[obtained from the expansion of (p + q)"]. Neither this 
significant distribution of signs of deviation nor the 
chi-square of the frequency distribution of scores is 
wholly independent of the deviation critical ratio evalu- 
ations, yet since it is possible that they could have been 
insignificant while a critical ratio of the total scores 
was Significant, they do offer further support against the 
applicability of the optional stopping hypothesis. 


This lengthy discussion of the optional stopping 
hypothesis is regarded as fully warranted in view of the 
possible applicability of this hypothesis to all analyses 
of ESP results (and, of course, to all other statistical 
findings). Until the fullest implications of Greenwood's 
analysis of the optional stopping hypothesis (4) are 
worked out, it will be necessary to be guarded in drawing 
conclusions from marginal critical ratios (e.g., in the 
region of 2.5 to 3.0). It is safe to say the proper pool- 
ing of results eliminates the possibility of an optional 
stopping effect up to the end of the final series included 
in the pool; that is, there is only the option as to the 
pooling point. The same cannot be said of the combination 
of critical ratios by the chi square method, in that each 
series treated is subject to the optional stopping hypo- 
thesis. While, therefore, the combination chi squares of 
Tables III and VI are subject to this counter-hypothesis, 
any serious concern may be removed by calling attention 
to the fact (1) that this method of evaluation is not the 
one primarily used and hence could not have been the basis 
of determining the pooling-point. (2) The method and its 
results could be ignored without affecting the conclu- 
sions. It is secondary and supplementary; though it is 
not a wholly independent measure. 





7+ To allow for the possibility that, had the signs gone in the di- 
rection opposite to that experimentally expected, the results 
would still have been considered statistically, this value is 
multiplied by 2, giving .000,92. 
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This is as far as it seems warranted to go for the 
present into a consideration of the optional stopping hy- 
pothesis of selection of data. Perhaps the best assurance 
avatlable on this question ts the fact that pooling at any 
potnt since the beginning series in precognition tests 
would have given a significant C.R. ; 


It has already been stated that the regular pro- 
cedure followed required the statement, in advance of an 
experimental series, of the number of runs to be conducted; 
upon which the Record Librarian issued the required nun- 
ber of serially numbered officially stamped sheets. These 
sheets were all to be returned to him and thus accounted 
for, whether filled out or not. In 5 out of the 7 series, | 
this was done exactly as was intended, with all the record 
sheets filled out. In the third of the five series of 
the Adult Division, however, the quota was completed for 
all but 20 runs out of the 200 prescribed when the Christ- 
mas holiday season arrived. Rather than hold the series 
incomplete for this small number of runs and to resume 
with the subjects in a possibly very much altered attitude, 
the series was declared closed and the record sheets re- 
turned blank. In the fourth series of the Adult Division, 
there had been scheduled in advance a total of 400 runs. 
At the close of this series, which was to be the last, 
an opportunity provided itself to introduce a group of 
adult visitors to the Laboratory and because of growing 
interest in apparent group effects on scoring an emer- 
gency extension of the series was requested and record 
sheets provided to extend the series from 400 up to the 
total of 580 which had been the total of the three pre- 
ceding series on reward vs. no reward. As it happened, 
with the end of the session of group tests 128 runs had 
been added, making a total of 528. With no comparable 
subject situation in prospect for the completion of the 
series and with other experiments occupying the time and 
interest of both subjects and experimenters, the remaining 
unused record blanks were at length turned in to the Li- | 
brarian. The slight irregularity or departure from the 
prescribed schedule in this instance may be dealt with in 
either or two ways. First, the extension series of 128 
might be set aside, if there were any warrant to do so, 
without affecting the general significance of the report, 
or it may be endorsed as a legitimate part of series 4. 
The latter treatment has been followed as the simpler pro- 
cedure, since the critical ratio of the Adult Division is 
altered only from 3.40 to 3.59 by the inclusion. 


Hypotheses of competence and trustworthiness. 
The ono tenant procedures for all of the work herein 
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reported was so planned as to make two experimenters mu- 
tually responsible for the safety of the results. In or- 
der to avoid clerical errors of any kind, each experiment- 
er kept his own records and kept these in his possession 
until totals were computed and checked. Even then a re- 
cord of the totals was left in the possession of each ex- 
perimenter. Consequently, there was no moment at any 
time when one experimenter could make an error without a 
discrepancy occurring between the two records and re- 
quiring checking up and eventual discovery. The rule re- 
quiring the acceptance of the score nearer the chance mean 
in the event of discrepancies safeguarded the experiment 
fully from errors of this nature. 


Improper arrangement of data. Under this headin 
might be proposed the question whether the Child and Adult 
Divisions scores should not have been pooled instead of 
treated separately. Thus the deviations would tend to 
cancel and the results would give an insignificant criti- 
cal ratio. Even so, the score frequency distribution 
would still give a significant chi square; P = .0107. 
[See Table if. The grounds for keeping the divisions 
separate in the evaluation of the results may be reviewed 
briefly. First, the experimental divisions were planned 
separately and indicated as separate expgrinents in the 
advance descriptions filed at the start. Separate 
batches of record sheets with different serial numbering 
were issued for the two divisions. Moreover, all the 
work of a comparable character done previously with chil- 
dren under similar conditions had led to the expecta- 
tion of positive deviations. On the other hand, the pre- 
vious work of comparable character conducted with the 
adult subjects used in the series reported here had given 
negative deviations, as the Introductory Series A and B, 
and a continuation under the circumstances would hardly 
be construed as having the same expectation as that of 
the Child experiment. Furthermore, the repetition of 
series after series, each Child series yielding positive 
results and each Adult series yielding negative devia- 
tions, could hardly make more plain and irrefutable the 
direction of expectation and the purpose of the comparison 
of the Child and Adult performances. Finally, it is pos- 
sible to apply a method of evaluation, a chi square con- 
bination of critical ratios, which can be used with 





8. The direction of deviation expected was not given in the advance 
statement of experimental plan in any of the seven series; these 
statements were open to inspection by the Laboratory staff-mem- 
bers, most of whom were serving as subjects. For them to know 
that a negative trend was expected of them might have changed the 
actual trend. 
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disregard of the direction of deviation. Thus allowing 
that each series might equally well have been expected to 
be positive or negative, the critical ratios are combined 
and the combination chi square obtained. As shown at the 
bottom of Table IV, the result is still significant; (P = 
-0012). Similarly the critical ratios of the two Divi- 
sions may be combined, as is done in the same table (P = 
- 000037). 


Alternatives to the Precognition Hypothesis that 
Involve ESP 


If, as would appear from the evidence available, 
the results cannot well be attributed to chance and since 
the experimental conditions could hardly have permitted 
sensory cues, card defects, shuffling inadequacies, er- 
rors in recording or other clerical work, or the selection 
of data to have influenced the results in favor of high 
scores, it is necessary to consider what other hypotheses 
are alternative to precognition. It appears necessary to 
assume that some causal relation existed between the per- 
formance of the subject and the extra-chance results, and 
that in some way the subject was effectively oriented in 
his responses. Thus he was behaving as if he were able 
to discriminate between situations, one of which (the 
order of the key cards) did not at the time (in our ac- 
cepted usage of the term) exist. In laying his cards op- 
posite five blank key spaces to be occupied later by the 
key cards when they were selected, he was, it would seem, 
responding to a purely future situation--reacting reli- 
ably to a seeming unreality. Superficially, at least, 
this would seem to be impossible, perhaps as completely 
absurd to present conceptions as anything which could well 
be fancied. 


But the alternatives of which I am aware are hard- 
ly less so, unless one rebels against the inference of 
causality from the statistical results of an experiment 
(and even here common sense is allied with statistics, as 
for example, to cite only one instance, in all seven ser- 
ies and in all 14 subseries of Table VY, the sign of the 
deviation is as expected. In other words, the student 
in his discomfort over the alternatives may choose to 
await more statistical evidence of the same kind, but 
hardly to find fault with the quality of that presented 
in this report. 


The two most natural alternatives to the inference 
of the hypothesis of precognition are rational inference 
and exercise of control over the precognized series of 
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events, making it occur according to prediction. To fol- 
low the former alternative in the present instance would 
mean to develop the hypothesis that, as the subject 
matches the cards opposite the blank spaces, he is com- 
bining his ESP impressions of the cards with a (subcon- 
scious) rational set of inferences as to the probable oc- 
currence of the pattern of key cards to follow. With our 
present knowledge, however, it would seem entirely gratu- 
itous to assume any basis for rational inference as to the 
probable appearance of the sequences of key cards either 
by attempting to judge in advance the probable rearrange- 
ment of the cards in the shuffling machine, or to attempt 
reliable inference as to the most likely total number of 
spots on the upturned faces of the dice. No hope for es- 
cape from the precognition hypothesis over this route 
seems, to the present writer at least, to be offered. 


The other alternative requires that the subject, 
or some other interested party, to some extent determine 
the supposedly random events--in this case the selection 
of a given pattern of key cards. The person most likely 
to play such a role would be the experimenter whose task 
is to stop the shuffling machine and dice machine. He 
could by ESP have some fof course unconscious) impression 
of the order of the cards laid down by the subject, even 
though he is located in a different room, and he might 
also, it is supposed, use this ability to good effect in 
apprehending the contents of the shuffling machine and 
could decide upon a favorable moment to stop it. He was, 
however, required by the instructions to stop it immediate- 
ly on hearing the buzzer (each machine had to be stopped 
in a given position); i.e., at the next suitable stopping 
point. This meant that no further revolution was per- 
mitted and that accordingly the precise stopping point 
was determined with a minimum of latitude left to the ex- 
perimenter. He was barred from exercising any control 
over the machines that could determine the order of the 
cards. If the subject is supposed to have some knowledge 
through ESP of the behavior of the cards in the shuffling 
machine, the constant motion of the machine right up to 
the point where he lays down his last card must prevent 
any use of this supposed knowledge, unless it be of a 
precognitive character, from being utilized in the dis- 
tribution of the deck. 


What is left, then, as the only possibility at 
present conceivable is that there is some way by which 
the experimenter or subject can influence the behavior of 
the cards in the shuffling machine and the dice in the 
dice machine so as to make them favor a pattern which 
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will give a better-than-chance score when the cards are 
checked against them. It will perhaps seem a no more pre- 
posterous supposition to imagine some extension beyond 
the musculature of the influence of mental processes, 
something corresponding to motor activity (extra-motor 
behavior), as extra-sensory perception does to sensory. 

As a matter of fact, neither this hypothetical kinetic ef- 
fect of mental process ("telekinesis" in the terminology 
of psychic research) nor the supposition of extra-sensory 
perception of card orders that do not yet exist are easy 
to entertain in relation to present day conceptions of the 
nature of mind. 


If one is to make his choice purely on the basis 
of such logical grounds as there are, he will doubtless 
find it easier to prefer the precognition hypothesis to 
the kinetic alternative described. The increasingly ex- 
tensive background of the ESP research itself favors this 
choice. It has also been pointed out above that since the 
evidence against the spatial limitation of ESP is consid- 
erable (11: ch. XIII) and since spatial and temporal cri- 
teria are apparently interdependent, it is logical to ex- 
pect it to be free from time restriction. In the light 
of this and other considerations, the critical reader, 
faced with this dilemma and lacking experimental evidence 
for the "telekinesis" alternative, will presumably favor 
precognition. There is, however, no need to reach a final 
conclusion upon the evidence reported in this article. 
Others will follow as a matter of course, from other ex- 
perimenters. 


Some Incidental Findings 


The effect of rewards. In the five series, three 
of the Adult and two of the Child Division, in which each 
experimental round of eight runs was divided equally be- 
tween reward and no-reward conditions, the results do not 
present a reliable difference. With the children, the de- 
viation for the reward runs was approximately twice that 
of the non-reward runs; +65 for 150 runs for reward, and 
+33 for the same number of ‘non-reward runs. (See Table Y) 
It was obvious to the experimenters that the children were 
much more interested in the reward runs and were frank in 
their expressions of regret if they obtained a high score 
on the no-reward runs. They did not, however, express 
any desire to score below chance. They understood that 
the experimenter always wanted high scores and they were 
willing to try for them. They simply wished that any high 
scores they might obtain would come in the reward series. 
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With the adult series the case was somewhat re- 
versed both in scores and in attitude. There was no doubt 
of the desire of most of the adult subjects to obtain the 
reward, but since most of the subjects were not only per- 
sonal friends, but were in some way connected with the re- 
search of the Laboratory, there was genuine appreciation 
for the importance of high scores on the no-reward runs. 
There was accordingly much more appearance of conscienti- 
ous effort on the part of the adult subjects to do good 
work on the no-reward runs as well. There is, however, 
no criterion of the impressions just mentioned other than 
the observer's personal judgment. The actual deviations 
obtained in the three series for adults were for 290 re- 
ward runs -66 and for the same number of no-reward runs 


-95. 


It appears that an uncomplicated no-reward con- 
trol was desirable with a view to providing a basis for 
comparison for the mixed (i.e., reward vs. no-reward) 
series. As nearly as possible the same subjects were 
used in approximately the same number of runs in the con- 
trol series. This could not, however, be done exactly. 
Two hundred runs were required of the child subjects and 
528 of the adults. As would be expected, the motivation-- 
particularly with the child subjects--was noticeably dif- 
ferent so far as can be judged by expressions of interest. 
There were not, however, any expressions of negativism 
from either group of subjects. There were in both Divi- 
sions, but particularly with the children, definite ex- 
pressions of preference for the reward vs. no reward 
series as distinguished from the no-reward series. 


The result for the children was a positive devia- 
tion of 25 in the 200 runs. Compared to the reward vs. 
no-reward series which altogether averaged .32 per run 
above the mean for 300 runs, this control series averaged 
only .13 above. Taking in order first the reward runs 
and second the non-reward runs appearing in the reward 
series and third the purely non-reward series, we have 
the following average deviation per run: .43, .22, .19. 
While these differences are not significant, they are 
sufficiently in line with general expectation to be at 
least suggestive. With the children at least, the re- 
wards would appear to be generally associated with higher 
scoring. No-reward runs occurring in the same experiment- 
al round with reward runs might be said to catch something 
of the advantage attaching to the rewards, while the pure- 
ly non-reward series though still positive in trend no- 
ticeably suffered from reduced motivation. It is repeated 
that these are regarded as suggested but not proved by 
the results. 
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In the adult no-reward series, likewise, the de- 
viation was considerably less; whereas for the 580 of the 
mixed reward and no-reward series the average deviation 
had been .28, it dropped to .15 for the 528 runs of the 
control series. The sequence for reward runs, no-reward 
runs associated with reward runs, and the control no- 
reward series is as follows (giving average deviation 
per run): .23, .33, .15. Table V presents the results on 
the comparison just reviewed. (See also Table IV for the 
se of the series from which the comparisons are 
made. 


The most general and consistent effect suggested 
by the reward study is that merely having rewards associ- 
ated with the experiment (as in the reward vs. no-reward 
series) makes the tests more interesting, the average de- 
viation greater. Not only was this true of the reward 
runs but to a greater or less degree of the non-reward 
runs made during the experimental sessions when rewards 
were given. This spread of effect is somewhat similar to 
the findings of Woodruff and George (15). They obtained 
a significantly higher average score for the entire month 
during which small prizes were offered in alternate weeks 
to the highest scoring subject of the week; but they did 
not find that there was any difference between the no- 
prize weeks and the prize weeks for the month in which 
the prizes were given. It appears that a very diffused 
improvement of interest attached to the experiment through 
the month in which rewards were offered. Though signifi- 
cant differences are lacking in the present work, it is 
not difficult to concede some enhancement of deviation as 
due to the reward, but it appears that the reward effect 
is somewhat generally diffused to cover the entire experi- 
mental session, especially with the adult subjects; much 
the greater differentiation between reward and no-reward 
runs occurred with child subjects. 


It is relevant to inquire whether the lower aver- 
ages of the control (no-reward) series were not inciden- 
tally due to decline trend occurring with the progress of 
the experiment over a long period, since such effects have 
been earlier reported (8). Table IV shows, however, that 
(a) in the Child Division there was little decline from 
series 1 to series 2; and that the drop in series 3 was 
accordingly abrupt; and (b) that while there was a higher 
average at series 2 of the Adult Division than in series 
3, series 1 was still lower than series 3; also, the divi- 
sion of series 4 into the originally scheduled 400 runs 
and the extension of 128 runs, shows that the latter gave 
a higher average than the former. The decline hypothesis, 
therefore, does not fit the results. 
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Shuffling machine vs. dice machine in the selec- 
tion of key cards. At the beginning of the work reported 
in this article, provision was laid down in the instruc- 
tions that the first two sets of keys at the west end of 
the laboratory table should be selected by the shuffling 
machine while the two at the east end should be selected 
by the dice throwing machine. No check-up was made as to 
whether a difference was occurring between the results of 
the two procedures until the final analysis of the work 
here reported. It was then observed that a considerable 
difference obtained in the deviations from the two methods 
of selecting the key cards, a difference which like the 
effect of rewards is insignificant in itself, but which 
is consistent enough for the two divisions to occasion in- 
terest. Pooling all adult series together, there are 
554 runs using the shuffling machine and an equal number 
for the dice throwing machine. The first gave a total 
negative deviation of 159, and the second (dice) a total 
of 80. That is, the deviation with the shuffling machine 
is practically twice that of the dice machine. Details 
from which these totals are taken are given in Table IV) 





The difference was even more marked in the Child 
Division. There 250 runs with the shuffling machine give 
a total positive deviation of 97 while that with the dice 
machine totals 26. The fact that the shuffling machine 
is associated with a larger negative deviation in the 
Adult Division and a larger positive deviation in the 
Child Division suggests that it is associated with the de- 
viation-producing factors in the experiment--that is, 
factors of ESP character. But the force of the suggestion 
is considerably diminished when it is discovered that 
there is no consistency of trend from series to series-—- 
that is, the shuffling machine is associated with higher 
scoring in one and lower in another, with about a 
frequency. To the experimenters it appears plausible to 
suggest that the differences found in the shuffling and 
dice selected work may be, if not accidental, more a mat- 
ter of position and sequence than anything else. The 
subject usually began at the shuffling end of the table, 
that is, where the shuffle selected keys were to be 
placed, followed around the table with the two more dice- 
selected runs and ended with the last two runs opposite 
the shuffle selected keys. The "end-effect" hypothesis 
might well be applicable here, the shuffling machine tend- 
ing to get whatever advantage attached to the beginning 
and end runs. It will remain, then, for further investi- 
gation to distinguish between this hypothesis and that 
which supposes that key cards selected by the shuffling 
machine have a better chance at being associated with 
high scores than if they are selected by the dice throwing 
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machine. Obviously if the shuffle and dice selected keys 
had been reversed at proper intervals in the progress of 
the investigation, more light would have been thrown upon 
this point. The question, however, was an incidental one 
at the time and the need for variation was overlooked. 


Group test effects in the work of the Adult Divi- 
sion. At the beginning of the experimental work covered 
in this report, it was the common practice to have present 
in the Laboratory only one subject at a time. Later two 
were allowed to work at the same table and from time to 
time an occasional trial would be made with a larger nuna- 
ber. The maximum that could be allowed to work at a time 
was eight, since there were eight runs possible to a round, 
The impression was given that when a number of adults were 
working together an enhancement of interest occurred and 
that there seemed to be reflected an increased score ef- 
fect--that is, larger deviations in the direction experi- 
mentally desirable. Accordingly as the program advanced 
larger portions of the series were given over to the group 
experiments, except that in the no-reward control series 
an effort was made to balance the proportion of group 
tests, making it roughly comparable to that of the other 
series. A check-up on the comparison of deviations pro- 
duced with different numbers of subjects present at one 
time reveals definitely that the impression was a correct 
one; in fact, the largest deviation occurred with the 
largest number of subjects. (This effect is confined to 
the Adult Division since there were only five subjects 
used in the Child Division all together--not enough to try 
a round of eight.) From the total of 1108 runs, averaging 
-216 per run below expectation, the 656 runs done with 
one to four subjects present averaged .155 below the mean 
(C.R. = 2.03) while the 452 runs done with eight subjects 
working at a time or eight or more subjects present in the 
room averaged .303 per run below (C.R. = 3.22). 





Certainly, then, it may be said that under these 
circumstances and with the objective of obtaining a nega- 
tive deviation, the effect of group agp te appears to be 
a favorable one. Further evidence is required, however, 
to determine whether this is a general relationship, as 
the present results do not show a statistically signifi- 
cant difference and the results represent, in part, a 
post hoc selection of data. The principal effect produc- 
ing the statistical significance of the Adult Division re- 
selis as a whole comes from work done under conditions of 
group testing. It must be kept in mind, of course, that 
in all these instances the subjects were well acquainted 
with each other, were together for a common purpose, and 
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all entered into the test procedure with a social spirit 
resembling that of a game at a party. In comparison to 
this, the condition of working alone, especially since it 
involves laying out eight packs of cards at a round, can 
readily be seen to offer a relatively less attractive 
situation. 


The question of the causation of the different 
trends of deviation in the Adult and Child Divisions. It 
may be said at the outset that negative deviations which 
appear to be of extra-chance character afford considerable 
difficulty of explanation. Hypotheses have been offered 
to explain unintended or ostensibly unintended negative 
deviations, accounting for the effect first as ESP ability 
plus unconscious negativism, and second as a kind of "bad 
aim" or ESP illusion, implying no change of motivation but 
the adoption of a consistently wrong method of exerc) sing 
ESP so that its function is systematically diverted. In 
view of the wholly unconscious character of the essential 
hein f involved in extra-sensory perception, it is not 
difficult to conceive of either hypothesis being appli- 
cable. However, the former seems more elaborate since it 
requires the additional supposition of unconscious and 
conflicting motivation. The latter, the blind but con- 
sistent fatiaaioe of a eee mental procedure, would 
at all events seem more applicable to the present situa- 
tion. Certainly the subjects who participated, adults as 
much as children, had no reason to be negatively motivated. 
They were all interested in the subject and such condi- 
tions as the introduction of rewards and the group test-- 
conditions that obviously made the test program a more 
pleasant one for the subjects--accentuated the deviation 
trend already established. It would seem accordingly that 
if by strengthening the motivation of the subjects a more 
negative deviation was obtained, it is likely that it was 
"bad aim" that was concerned. 
































I had attempted earlier to account for significant 
negative deviations obtained with tests involving enclosed 
cards (sealed opaque envelopes) in the course of which 
there was considerable delay in informing the subject of 
the scores, tests mainly conducted by correspondence. I 
was inclined at the time to look upon this negative devia- 
tion as due to the annoyance and frustration experienced 
by the subject over the prospect of not being able to 
check up on scores, not to find out what was in the envel- 
ope until several days later. This was the negativism 





9. These two hypotheses have been facetiously but more graphically 
hypo 


called the "double-crossing" and the "crooked barrel theses. 
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hypothesis. But it is equally plausible, perhaps more 
so, to suggest that the subject working in isolation, con- 
centrating intensively on the enclosed cards with a view 


to sending in his records to the Laboratory, might have 
been giving enough additional effort that in his uncon- 
sciousness of the actual procedure to follow mentally, 
he--to use a figure--overshot the mark; that is, he seized 
upon a way of doing a test that systematically reversed or 
digressed from the casual, normal procedure which ESP 
would involve. In the present experiment, likewise, the 
subject being especially cooperative and appreciating per- 
haps to an excessive degree the significance of the pre- 
cognition hypothesis, may have kept doing his best intro- 
spectively to seize upon a really superior way of exer- 
—— his latent ESP ability; he may reasonably enough 
have laid hold of what was for him a perverse technique 
and accordingly the more he held to it, the stronger his 
motivation (e.g., enhanced by rewards), the more he 
matched the cards in a way that they should not have been 
matched. 


Owing to the fact that the tests of the present 
series were tests of precognition, it is conceivable that 
the average subject's natural scepticism of precognition 
(producing feeling of frustration) might account for nega- 
tive motivation. This was at least faintly suggested by 
the Introductory Series A in which the clairvoyance half 
of the series yielded a positive average, and the precog- 
nition half gave a negative deviation. 


As stated at the outset, there is no easy explan- 
ation for the consistent trend of negative deviation by 
the group of subjects responsible for the Adult Division 
tests. Fortunately for the bearing it may have upon the 
precognition hypothesis, this explanation need not for 
the present be determined. A reliable relationship, even 
of negative character, would be good enough as a starting 
point. Nevertheless it remains a puzzling question; and 
accordingly the remarks that have been made on the subject 
are not submitted with strong conviction. 


Similarity of negative and positive deviations. 
The average Seetetios per run of the Adult Division was 
-22 and that of the Child Division, .25. Since these de- 
viations are of opposite sign, the similarity in average 
is of interest. The comparison goes further: The average 
deviation per run for the no-reward series of the Adult 
Division was .15, and for the Child Division .13; while 
deviations per run of the reward vs. no-reward series of 
the Adult Division averaged .28 and of the Child, .33. 
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ain, the shuffling machine selection gave for tne Adult 
and Child series respectively .29 and .39 average devia- 
tion per run, and for the dice machine selections .14 and 
.10. These approximate similarities are interesting and 
warrant some consideration as to the factors that may have 
contributed to them; especially since the similarity would 
theoretically not be expected. 


As was pointed out by Thouless (13) and as is in- 
dicated by Foster's ESP quotient formulae (see his article 
in the preceding issue), if equal positive and negative 
deviations occur, there is inferable ESP capacity in the 
two cases in approximately a 4 to 1 ratio. The ESP quo- 
tients of the Adult and Child Divisions are respectively 
4.40 and 1.25 (computed from the deviations -.22 and 
+.25, and assuming that the fostered negative deviation 
of the Adult Division work was equivalent to that of a 
deliberately low-aim series). This would seem to indi- 
cate that whatever is measured by the ESP tests existed 
in approximately a 4.40-to-1.25 ratio in the two groups 
of subjects tested under similar conditions. 


It must be borne in mind that this similarity of 
deviations may constitute a random event; but there have 
been other instances that have some supporting influence 
upon the case--particularly those in which subjects de- 
liberately tried to obtain negative deviations for com- 
parison with the positive deviations they had obtained in 
other series. In 1934 1 reported the results of high-aim 
vs. low-aim experiments on two subjects. The first sub- 
ject, H.P., (8: p. 30) obtained in 11 runs of low-aim, a 
negative deviation of 3.2 per run. His average for the 
total of 690 high-aim runs produced by him at the time of 
the report gave an average positive deviation per run of 
3 (although at the time of his low-aim tests the more 
comparable average positive deviation of 4.2 on 200 high- 
aim runs represents a closer approximation to the condi- 
tions of the low-aim tests). The other subject was Mr. 

C. E. Stuart, of this Laboratory, (8: p. 70) who con- 
ducted his own experiments, serving as subject himself. 

In 52 runs on which he made both high-asaim and low-aim 
calls on the same card, he obtained an average negative 
deviation of 1.5 per run and an average positive devia- 
tion of 1.6. In the report of Pegram (5) on comparison of 
high-aim and low-aim ESP tests, it is noted that the low- 
aim produced a deviation per run of -.65 while the total 
high-aim work (which was more than five times as great as 
the low-aim) gave +.30. But when the high-aim average de- 
viation that was obtained during the period in which the 
low-aim experiments were conducted is considered alone, 
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the results are fairly comparable; namely, for 665 runs 
of high aim, an average positive deviation of .56 per 

run was obtained, and for 1468 runs of low aim, an aver- 
age negative deviation of .65 per run. Other compari- 
sons are offered by Pegram but those cited would appear 
to be the more fiom Hs: comparable. Altogether the data 
cited raise the question whether the ratio of 4 to 1 re- 
ferred to above fully covers all the factors inherent in 
the ESP situation where low-aim and high-aim tests are 
made (and in the equivalent case represented by the Adult 
Division in this report in which for some reason a per- 
version or consistently bad aim of the ESP process oper- 
ates to produce significant negative deviations when posi- 
tive scores are sought by the subject). 


There are on the other hand at least three in- 
stances on record in which negative deviations have been 
produced which had been relatively small in comparison to 
the positive deviations with which they might with some 
reason be compared. First in the case of the subject 
A.J.L. (8: p. 63), whose work I reported in 1934, the 
negative deviation obtained (by pressing continuation of 
the tests aeaent the subject's will) was related to the 
just preceding positive deviation in a ratio of about 1 to 
5. Second, in the enclosed card work (7) reported in 1938, 
there was found a negative deviation for one experimental 
condition (correspondence tests with long delay in check- 
ing) that was related to the positive deviation of the 
main series (immediately checked) in the ratio of between 
1 to 5 and ito 6. Third, in Table IV it may be seen that 
the correspondence precognition tests with long delay in 
checking gave, as those just referred to, a negative devi- 
ation; in this case the ratio to the comparable laboratory 
tests is about 1 to 3. (See Appendix.) However, in none 
of these instances were the conditions giving both trends 
of deviation comparable and it is somewhat hazardous to 
speculate upon the equivalent of the factors producing the 
deviations. Certainly the low-aim studies are the best 
for comparison, and the deliberately cultured negative de- 
viation in the Adult Division ought to stand a close se- 
cond. 


If it be justifiable to assume for the moment that 
the most of (and the most comparable of) the experiments 
dealing with high-aim tests and low-aim tests (including, 
on the hypothesis of bad aim, the Adult Division) pro- 
duced approximately similar positive and negative devia- 
tions, there is clearly an explanation demanded. Either 
it must be assumed on the 4 to 1 expectation that subjects 
trying for low-aim (or with the reversal of aim under the 
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circumstances of the Adult Division) possess four times 
the ESP capacity involved in the production of the posi- 
tive deviation; either that or else there is some compen- 
sating factor or circumstance which is at present unknown. 
It is because of the possibility of experimentally dis- 
covering such a factor, if it exists, that the following 
hypothesis is raised for eventual testing. 


If the subject's act in the ESP card tests be as- 
sumed to consist of a simple unitary determination of 
likeness of symbols for high-aim or unlikeness for moti- 
vated negative deviation (as Foster's Diametric Function 
Hypothesis would imply--see article in the preceding is- 
sue) there would have to be, to satisfy the 4 to 1 ratio, 
four times as many successful determinations of unlike- 
ness in motivated negative deviation series (to achieve 
the same deviation) as there would be successful deter- 
minations of likeness in the high-aim. Accordingly, to 
compensate for the 4 to 1 ratio and achieve the approxi- 
mately equal deviations actually obtained, there must be 
supposed in determining unlikeness of symbols in the mo- 
tivated negative series some greater facility for missing 
than for hitting when the probability of missing is 
greater; in fact, it should be proportional to the rela- 
tive probabilities of missing and hitting. That this is 
so is in effect the statement of the hypothesis here sub- 
mitted. If the choices were limited to two, likeness 
and unlikeness would be equivalent, but the smaller the 
p value or the greater the range of choice, the less the 
(ESP) perceptual acuity that is involved in the intention- 
al determination of unlikeness and, correspondingly, the 
greater the perceptual acuity required for the determina- 
tion of likeness in high-aim tests. 


Specifically, if the subject is working in a low- 
aim test with ESP symbols the four possibilities for un- 
likeness are combined, approximately equal be hone, hima 
to the one possibility of likeness--i.e., successfully 
avoiding likeness requires no further consideration as to 
which of the four possibilities to take. It reduces the 
task 2 peng, josey 4 to a simple dichotomy of approximate- 
ly similar values, and accordingly, while four times as 
many successful unlike decisions are required per unit 
of deviation resulting, there is demanded proportionately 
less perceptual acuity (or whatever is responsible for 
extra-chance performance in the tests); and it might be 
said the task is four times as easy. 


It is obvious that this is a problem for experi- 
mental study and it is strictly in that interest that it 
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is discussed here. The hypothesis just offered has, how- 
ever, a bearing upon another important question; namely, 
that of accounting for the apparent fact that decreasing 
the p-value in an ESP test seems also (everything else be- 
ing equal) to decrease the number of hits in the series 
attributable to ESP. For a tabular summary of results ob- 
tained with different p-values and for a statement of the 
corresponding ESP quotients (percentages of hits attri- 
butable to ESP alone) the reader is referred to page 271 
of Extra-Sensory Perception After Sixty Years, although 
he must not be led to expect there anything but the sun- 
mary of incidental tests with different p-values. No con- 
prehensive experimental comparison has yet been made. Ap- 
plying the hypothesis of unequal facility in determining 
likeness and unlikeness in high-aim and low-aim tests it 
may be seen that the smaller the p-value the relatively 
more difficult it should be to make hits in high-ain 
series because of the higher perceptual acuity involved 
in the likeness vs. unlikeness decision inherent in each 
trial; conversely, the easier it should be to determine 
unlikeness by ESP in motivated negative series, as much 
easier, in fact, as the ratio of C1 - p) to p. Actually 
the table referred to will not prove or disprove this hy- 
pothesis. There are too many other factors involved to 
permit any clear-cut effect in any case. But it appears 
to offer some support to what is given here as a question 
to be settled by test, and one that may help toward even- 
tual understanding of the psychology of ESP. 


Summary 


There is reported above the whole of the conm- 
pleted series of precognition tests using mechanical se- 
lection of cards, conducted by the author up to March 17, 
1939, with the extensive precautions (e.g., two independ- 
ent experimenters) that have been in operation since the 
fall of 1938. These series consist (1) of four series 
totalling 1108 runs of 25 trials each, called the Adult 
Division, which were conducted to follow up an hypotheti- 
cal score-depressant factor suspected of producing the 
negative deviations found in two preceding series men- 
tioned; and (2) of three series totalling 500 runs, 
called the Child Division, which were carried out as a 
control, with the expectation, based on earlier work with 
the same subjects, of obtaining positive deviations. Both 
lines of expectation were borne out, though at relatively 
marginal score averages. The grounds for the separate 
treatment of this work are given and in addition the to- 
tality of related but excluded work is summarized for ex- 
amination in an appendix. 
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The results, both as reported and as combined 
either with all the excluded work done with mechanical se- 
lection, or with all the known precognition experiments 
up to June, 1939 (with or without the previously reported 
hand shuffling work) are statistically significant. The 
body of results making up this report proper are analyzed 
in several ways to evaluate the probability of their oc- 
currence by chance: (1) the binomial critical ratio meth- 
od; (2) the empirical critical ratio; (3) chi-square fre- 

uency test; (4) the critical ratio of the difference; 
t5) the empirical critical ratio of the difference; (6) 
the combination of the seven series by the chi-square 
method; (7) the combination of the two divisions by the 
same method; and finally (8) the binomial calculation of 
expected sign frequency of the 28 logical sub-divisions 
of series. In all of these analyses, the results as a 
whole are significant. Cross-check controls were made on 
the five of the seven series in which they were possible, 
with insignificant measures by all the above methods. 


The experimental conditions are assumed to have 
excluded the possibility of selection, of sensory cues, 
or of errors producing the results obtained. All the in- 
portant and relevant hypotheses alternative to ESP that 
are known to the experimenter were discussed. Others 
may, of course, appear in the course of critical discus- 
sion. 


To account, then, for the significant relation 
found between the experimental performance of the subjects 
and the results, the ESP hypothesis is necessary and ap- 
pears sufficient; to account for the fact that the co- 
incident results involved the future, since there is no 
recognized manner in which either rational inference could 
have given knowledge of the future events, or purposive 
efforts have brought about the coincident happenings, it 
is further indicated that ESP is not limited to present 
events but is precognitive as well. However, considerable 
restraint is needed in offering and accepting this con- 
clusion, and more evidence is needed to give the hypothe- 
sis full and final establishment. The legitimate assump- 
tion at this point is that the evidence has reached a 
stage at which some new alternative hypotheses are needed 
if precognitive ESP is not to become an established phe- 
nomenon. 


10. By the 8th method of analysis, that of evaluating the sign or 
direction of deviation of subseries, the cross-check gives chance 
results. In the 20th subseries, exactly 10 gave the opposite sign 
to that experimentally expected; 9 gave the sign expected; and 1 
gave no deviation. 
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Certain incidental findings and suggestions are 
dealt with, concerning the effect of rewards, of differ- 
ent methods of selection of cards, of the number of sub- r 
jects participating at a time, the nature of the score- 
depressant factor, and the interesting and unexpected sin- 
ilarity in the negative and positive deviations per run in 
the Adult and Child Divisions. None of these minor find- 
ings is offered as conclusive, though it is believed they 
may be of some use to fellow experimenters in the field, 





| 
APPENDIX | 
' 
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An effort has been made in the compilation of 
Table VI to assemble in brief form a general summary of 
the essential data of all the known precognition experi- 
ments conducted up to June, 1939. There is, to my know- 
ledge, left out only the tentative report by Carington of 
experiments in predicting the throw of a die. This report 
was issued in a semi-private journal (1) and since it was 
based on a different p-value from all the other work yhich 
we reported, it does not readily pool with the rest.1 


As stated in the text, the occasion for the pre- 
sentation of this summarizing table is to present for 
critical consideration the complete background from which 
the material for the present paper is drawn. There is as 
= insufficient clarity in scientific circles as to exact- 

y what constitutes proper grounds for the separate eval- 
uation and presentation of a particular block of results; 
although there does not seem to be any reason to question 
the basis for the separate presentation of the seven 
series of experiments considered above, it was considered 
wisest to allow the reader to draw his own conclusions re- 
garding the propriety of selection and to observe that 
even if no selection whatever is made, the criteria of 
significance are met by the total results. 





The work involved in the assembling of the con- 
tents of the table is further justified by the opportunity 





11. Since this report was sent off to the Editors, Carington's more 
recent reports on "Paranormal Cognition of Drawings" have ap- 
peared; one in this Journal (June, 1940) and the other in the 
Proceedings of the Soctety for Psychical Research (June, 1940). 
In these he concludes that evidence of precognition is furnished 

by the results obtained from his experiments. 
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it provides for certain general observations over the ap- 
proaches to the problem of precognitive ESP. Broad com- 
parisons can be made between general conditions and tech- 
niques. The explorer may better judge from the inspec- 
tion of the mass of data given in the greatly reduced form 
required for tabulation, the relative fruitfulness of 
various lines of procedure which he might have under con- 
sideration, inasfar as these have been followed by others. 


The table consists of two sections. Section A is 
made up of items mostly representing individual researches. 
This section is divided into two subdivisions, the first 
dealing with the laboratory methods and the second with 
the correspondence work. In each of these subdivisions 
there are two further subdivisions representing the two 

eneral methods in use, the calling down through a pack 
Seeeana’ thre DT, or PDT) and second, precognitive match- 
ing (or PM). Under the PDT and PM methods there are in 
each instance four further sub-divisions as well--these 
representing different techniques of Ye pete the cards 
or objects against which the precognitive calling (PDT) 
or matching (PM) is directed. 


Section B is given to general comparisons, first 
of the two large groups of laboratory experiments and cor- 
respondence experiments. First these are compared in 
their entirety, and then a similar comparison is made with 
the hand shuffle work excluded. This is done to permit 
comparison without the question arising as to the possi- 
bility of ESP shuffle accounting for the hand shuffle 
results. A third comparison is made of the total hand 
shuffle work with the total mechanical selection results. 
Under each of these headings the distinction is made be- 
tween the laboratory experiments and the correspondence 
experiments. Totals of other shuffling methods are pre- 
sented as well. 


There could well be a lengthy discussion made of 
the results summarized in the rq dom Mon table. The prin- 
cipal point of interest here is the fact that these re- 
sults are, taken in their entirety, statistically signi- 
ficant. The grand total of 34,810 runs gives a critical 
ratio of 3.36. Also the chi square combination method 
— a highly ws ee gh probability (P = 107*?). 

ther ways of evaluating the results involve the compari- 
son of subdivisions of the results and will follow. 


Logically, if the results as a whole are signifi- 
cant, it is necessary to know next about the general ex- 
perimental safeguards. But while they can be said to be 
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Table VI 
GENERAL SUMMARY OF ALL PRECOGNITION EXPERIMENTS UP TO JUNE '39* 
Section A 
I Laboratory Experiments 
A. PDT Division 
1. Hand Shuffle 
Experimenter Runs Dev. S.D. C.R. _ 
JBR, SOZ, JGP 482 + 85 43.9 1.94 3.76 
SO0Z, MAP 654 * 2ah 51.2 4-12 16.97 
GZ, MHP 59 + 18 15.4 1.17 1.37 
S0Z 98 + 17 19.8 0.86 7h 
JBR 45 + 2 13.4 1.49 2.22 
GZ, SOZ 19 + 63 27.7 2027 5.15 
S0Z 66 - 6 16.2 0.37 14 
S0Z, JBR, Gz 22 - 12 30.2 0.40 -16 
JBR 948 ~ 59 61.6 0.96 +92 
GEB, JLM 35 i 30 11.8 205 6.45 
EPG 154 + 49 24.8 98 3.92 
JGP 1,146 + 41 67.7 0.6] 7 
JDMacF, LMcC, ES 335 + 165 36.6 4.51 20.34 
46 - 20 13.6 1.47 2.16 
Subtotal 4,488 + 602 134.0 4-49 64.67 
2. Mechanical Selection 
Experimenter Runs Dev. S.D. C.R. = 
EPG 14 + 4 7.5 0.53 28 
GZ, SOZ 70 - 26 16.7 1.56 2.43 
JLW (Duke) 1,560 + 132 79.0 1.67 2-79 
JLW (D.M.) 1,897 + 66 87.1 0.76 -58 
CES, JLW 1,794 + 168 82.7 2.03 4-12 
GNMT 90 + 89 19.0 4.68 21.90 
Subtotal 5,425 + 433 147.3 294 32.10 
3. Hand Thrown Dice Cut 
Experimenter Runs Dev. S.D. 3. ye 
CES are + 55 26.6 2.07 4.28 
JBR, VS 191 + 47 27.6 1.70 2.89 
Subtotal 368 * 302 38.4 2.66 7.17 
4. Newspaper Cut 
Experimenter Runs Dev. S.D. Ce. Tai 
JBR, JLW 1,652 +” 353 81.3 1.27 1.61 
EPG 100 - 4 20.0 0.20 -O4 
JBR 129 + 1 22.7 0.70 49 
JLW, BMS 170 - 45 26.1 1.72 2-96 
Subtotal 2,051 + 70 90.6 0.77 5.10 
PDT Division Total 12,332 +1,207 222.1 5.43 109.04 
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B. PM Division 
1. Hand Shuffle 


Table VI (cont'd) 






















































































Experimenter Runs Dev. S.D. CRs “7 
‘JGP, EB 45 + 12 13.4 0.90 -81 
LHG, EPG 154 + 49 24.8 1.98 3.92 
Subtotal 199 + 61 28.2 2.16 4.73 
2. Mechanical Selection 
Experimenter Runs Dev. S.D. 6.9 ¥* 
BMC, BMS 813 - 69 57.0 1.21 1.46 
JBR (Incomp. Miscl.) 236 + 8 30.7 0.26 -07 
" (Adult) 1,108 - 239% 66.6 3.59 12.89 
" (Child) 500 ¢ i722 44.7 2.75 7.56 
LER, JGP 282 + 57 33.6 1.70 2.89 
CES, JGP 1, 368 + 98 74.0 1.32 ey! 4 
Subtotal 4,307 + 456 131.3 3.47 26.61 
3. Hand Thrown Dice Cut 
Experimenter Runs Dev. S.D. C.R. 5 hes 
JBR (Adult) 80 - 12 17.9 0.67 0.45 
n " 400 - 23% 40.0 9.57 0 .32 
Subtotal 480 + 2 43.8 0.25 0.77 
4. Miscellaneous Selection 
Experimenter Runs Dev. S.D. C.R. t Ag 
JBR (Music) 995 - 33 63.1 0.52 27 
" (Control) 995 + 35 63.1 0.55 -30 
" (Incomp.) 960 - 52 62.0 0.84 oTh 
Subtotal 2,950 - 50 108.6 46 1.28 
PM Division Total 7,926 + 478 176.2 71 33.39 
Total Laboratory 
Method 20,268 +1,685 284.8 5.92 142.43 
II Correspondence Experiments 
A. PDT Division 
1. Hand Shuffle 
Experimenter Runs Dev. S.D. C.R. x® 
EPG 1,594 - 13 79.8 0.16 -03 
Subtotal L,594 - a3 79.8 0.16 -03 
2. Mechanical Selection 
Experimenter Runs Dev. S.D. Cs x* 
J LW 270 - 30 32.9 0.91 -83 
EPG 3,188 + 49 112.9 0.43 -18 
Subtotal 3,458 + 19 117.6 0.16 1.01 
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Table VI (cont'd) 
3. Hand Thrown Dice Cut 
Experimenter Runs Dev. S.D. C.R. x* 
JGP 126 22.4 0.00 -00 
EPG 1,593 - 89 79.8 1.12 1.23 
Subtotal 1,749 - 89 82.9 1.07 Leas 
4. Newspaper Cut 
JLW 531 - 65 46.1 1.41 1.99 
EPG 1,591 - 719 79.8 0.99 0.98 
JG 295 + 1l 4d 0.32 0.10 
MMP 226 ~ 6 30.1 0.20 0.04 
JMacF 4,165 - 146 129.1 1.13 1.28 
Subtotal 6,808 - 285 165.0 73 4.39 
PDT Division Total 13,579 - 368 233.0 1.58 6.66 
B. PM Division 
1. Mechanical Selection 
Experimenter Runs Dev. &.D C.R. og 
EPG 963 - 64 62.1 1.03 1.06 
Subtotal 963 - 64 62.1 1.03 1.06 
PM Division Total 963 7 64 62.1 1.03 1.06 
Total Correspondence 
Method 14,542 - 432 241.1 1.79 7.72 
GRAND TOTAL 34,810 41,253 373.1 3.36 150.15 
P(?) = 10™ 
Section B , 
I Comparison of Laboratory and Correspondence Experiments 
Runs Dev. Aver. §.D. C.R. 
Laboratory 20,268 +1,685 5.083 284.8 5.92 
Correspondence 14,542 - 432 4-970 241.1 1.79 
Grand Total 34,810 +1,253 5.036 373.1 3.36 
Diff. Lab. & Corr. --- --- 113 --- 5.20 
II Comparison of Lab. Exps. with Corr. Exps. with Hand Shuffle Work 
A. Laboratory Experiments 
Runs Dev. Aver. S.D. C.R. 
Total 20,268 +1,685 5.083 284.8 5.92 
Hand Shuffle 4,687 + 663 1.141 137.0 4.83 
Other Selection 
Methods 15,581 +1,022 5.066 249.6 4-09 





Omitted 
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Table VI (cont'd) 


B. Correspondence Experiments 











Runs Dev. Aver. s.D. C.R. 

Total 14,542 - 432 4-970 241.1 1.79 

Hand Shuffle 1,594 - 13 4-992 79.8 0.16 
Other Selection 

Methods 12,948 - A419 4.968 227.2 1.85 





\ Grand Total Less 
Hand Shuffling 28,529 + 603 5.021 337.8 1.79 


[P(Comb.x*) = 1.5 x 10°] 
Diff. Lab. & Corr. ss ~<e .098 a 4-08 


III Comparison between Hand Shuffling and Mechanical Selection Results 
A. Hand Shuffle Selection 























Runs Dev. Aver. &.D. C.R. 
Laboratory 4,687 + 663 5.141 137.0 4.83 
Correspondence 1,594 - 13 4-992 79.8 0.16 
Total 6,281 + 650 5.103 158.5 4.10 
Other Selection 
Methods 28,529 + 603 5.021 337.8 1.79 
B. Mechanical Selection 
Runs Dev. Aver. &.D. C.R, 
Laboratory 9,732 + 889 5.091 197.3 4-51 
Correspondence 4,421 - 5 4.989 133.0 0.34 
Total 14,153 + 844 5.060 237.8 3.55 
Other Selection 
Methods 20,657 + 409 5.020 287.5 1.42 
GRAND TOTAL 34,810 +1,253 5.036 373.1 3.36 





*This manuscript was prepared January-March, 1940. Delay in publication permits the inclusion, 
in a supplement to this table, of all precognition test results of the year 1959-40, bringing 
the totals up to October 1, 1940. 


betel Sign reversed in pooling because negative deviation was expected experimentally. 
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SUPPLEMENT TO SECTION A, TABLE VT 


(Bringing Summary up to October 1, 1940) 


I Laboratory Experiments 
A. PDT Division 
2. Mechanical Selection 
























































Experimenter Runs Dev. 8.D. C.R. x 
LH, JGP 1,000 - 63.2 65 “ae 
LH 3,100 > 22 111.4 1.10 1.21 
Qld Sub-total 5,425 >» 699 147.3 2-94 32.10 
New Sub-total 95525 + 514 195.2 2.63 33.73 
B. PM Division 
2. Mechanical Division 
Experimenter Runs Dev. S.D. C.R. 5 
JBR 1,880 + oo 86.7 61 037 
Old Sub-total 4,307 + 456 131.3 3.47 26.61 
New Sub-total 6,187 + 509 157.3 3.24 26.98 
3. Hand Thrown Dice Cut 
Experimenter Runs Dev. S.D. C.R. x? 
JGP, JLW 2,200 > 93.8 96 °92 
LER, DHC, MS 577 - 2 48.0 -O4 -0016 
Old Sub-total 480 + 11 43.8 025 77 
New Sub-total 3,257 + 99 114.1 0.87 1.69 
New Total 
Lab. Experiments 29,025 +1,907 340.7 5.60 145.35 
II Correspondence Experiments 
A. PDT Division 
5. Miscellaneous Methods of Shuffling 
Experimenter Runs Dev. S.D. C.R. ras 
EPG 2,016 * 136 89.8 1.51 2.28 
New Sub-total 2,016 + 136 89.8 1.51 2.28 
New Total 
Corr. Experiments 16,558 - 296 257.4 1.15 10.00 
NEW GRAND TOTAL 45,583 +1,611 427.0 3.77 155.35 


P(x®) = 10%” 
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largely of a high order, they are not all equal to the 
work of the Adult and Child Divisions presented in this 
report. The only work that offers technically comparable 
precautions is the Mechanical Selection work under the PM 
subdivision of the Laboratory Experiments of Section A. 
Most other work is, in my judgment, essentially almost 
equal in safeguards; though this might be disputed. 


The comparison of laboratory and correspondence 
experiments in Section B is of special interest because 
of its confirmation of an earlier finding of similar char- 
acter (though with non-precognition tests). It may be 
noted that the correspondence experiments gave a negative 
deviation, while the laboratory results were positive. 
This corresponds to the results obtained in the enclosed 
card work (7) referred to above. In that work the tests 
in which the checking of the calls and the informing of 
the subject as to his scores were accompanied by delay 
(most of them being conducted by correspondence) gave a 
significant negative deviation, while the immediately 
checked (laboratory) experiments gave a significantly 
positive one. In the present case (precognition) the 
critical ratio of the difference between the two condi- 
tions is, as in the enclosed card work, statistically sig- 
nificant (CR Diff. = 5.20). 


In the second sub-division of Section B there is 
given a similar comparison with only the difference that 
the hand shuffle data are excluded. The elimination of 
the hand shuffle data does not make any essential differ- 
ence in the values obtained. The critical ratio of the 
difference is still 4.08. 


In the third sub-division of Section B a compari- 
son of the hand shuffle results and the mechanical selec- 
tion results is made. In both instances the critical 
ratios based upon total results for each method are sig- 
nificant, 4.10 and 3.55 respectively. 


Although the results summarized in the table are 
statistically significant, it is by reason of their large 
numbers that this is so. That is, the average deviation 
per run is extremely small; namely, .036. This means that 
whatever is to be assumed as the extra-chance factor pro- 
ducing the significant total deviation, it must be oper- 
ating almost at the vanishing point. There are at least 
three positions that might be taken on this point: the 
first, that the criteria of significance should be raised 
for work on such an a priori improbable hypothesis as 
this--raised to a point that would be well above the 
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probability values ascribed to these mass results. This 
will not, however, meet with mathematical approval; and 
further, the probability of 10-** that is given by the 
chi square combination method exceeds any figure that 
could reasonably be named as an advanced criterion. Se- 
cond, it might be suggested that such an average is all 
that can be expected of precognition tests, that there is 
something inherently more difficult in them compared to 
ordinary ESP. But we find that the average obtained by 
Pratt and Woodruff (6) in their 2400 runs of clairvoyant 
matching with safeguarding comparable to that of the Adult 
and Child Division gave an average deviation per run of 
+,20, which is somewhat smaller than the deviations ob- 
tained by both the Adult and Child Divisions (-.22 and 
+,.25). The next series to follow in my own investiga- 
tions (using the same adult subjects) after the completion 
of the Adult and Child Divisions was a clairvoyant match- 
ing test; the deviation in this was smaller than it had 
been for the adult precognitive matching (it changed from 
-22 to .03). Third, it might be supposed that with many 
investigators conducting exploratory tests in a little 
known region of problems that there would be increasing 
"waste motion" as the problems became more obscure and 
difficult. In preliminary stages, thousands of trials 
are conducted with very little ground to warrant then, 
with only the faintest promise and no assurance of signi- 
ficant results--all in the hope of finding a productive 
lead. This is a necessity in a pioneer research. It 
might account fully for the "dilution" of average devia- 
tion and is at least a reasonable possibility. 


But whatever the explanation, it is more impor- 
tant than ever to eliminate possible experimental error, 
since it would loom proportionately large because of the 
small margin; and on the other hand to remember that what- 
ever measurable phenomena occur in nature can presumably 
occur, under some circumstances, in barest traces. 
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CONDITIONS AFFECTING ESP PERFORMANCE 
Burke M. Smith and Edmond P. Gibson 


In this paper are presented, as direct quotations 
the opinions, judgments, and conclusions of experimenters 
concerning what may inhibit or facilitate performance of 
subjects in ESP tests. This is done in order that lines 
of further research may be indicated and initiated in 
the direction of verifying or refuting the more or less 
tentative statements that have been made. Progress 
toward understanding the phenomenon of ESP will result 
+ iad from actual experimental tests of these sugges- 

ions. 


As will be seen, there is great unanimity of 
opinion concerning certain points, and diversity of opin- 
ion concerning others. In making comparisons, however, 
it must be kept in mind that the descriptive terms en- 
ployed by different authors are not always adequate to 
ensure the reader of sufficient identity of situations 
to justify the superficially obvious conclusions. 


The main body of this paper is composed of quota- 
tions from research articles in ESP in which the authors 
have stated what to them seem to be pertinent and deci- 
sive factors. The material is arranged in a classifica- 
tion into which the items seemed most naturally to fall. 
There is, of necessity, a certain arbitrariness about 
the choice of topics under which to arrange the quota- 
tions. If the terminology of a particular system of psy- 
chology were to be used, there would be great difficulty 
in determining the relative appropriateness of the vari- 
ous systems and the applicability of the quotations. It 
was decided, therefore, largely to disregard technical 
terminology and to group the quotations under headings 
that are of general current usage, which is the language 
of the quotations themselves. Considerable latitude is 
allowed regarding consistency, because the primary ob- 
jective has been to make this material available with- 
cut forcing it into any particular systematic framework. 
There are, indeed a number of overlapping statements; 
these are indicated by cross references. Although no 
claim is made to an exhaustive search of all possible 
sources, it is felt that a reasonably comprehensive sur- 
vey of the literature of the past sixty years (1880-1939) 
has been made. 
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There is given in Table I a list of the condi- 
tions which have been suggested by experimenters as inm- 
portant for ESP performance, ranked as to frequency of 
mention. The figures in the right-hand column show the 
actual number of quotations bearing upon each condition 
or group of conditions. 


ons, 
ers 
of 


The quotations are alphabetically arranged under 
the names of the authors of the original reports in 
| which they occurred. The sources are given in the bibli- 
ography. In case more than one article by the same au- 
thor, or joint authors, have been quoted, the exact re- 
ferences are indicated by letters of the alphabet. 


TABLE I 


3 A SUMMARY OF QUOTATIONS ON CONDITIONS AFFECTING 
in ESP PERFORMANCE 


No. Conditions No. of Quotations 


es 


I. Freedom, Pleasure, Excitement, and Interest 24 
II. Disposition, Mood, Personality (Including 
Health) 
III. Variation and Decline of ESP Ability 
ba- IV. Abstraction, Relaxation, and Concentration 
rs VY. Distraction 
. VI. Witnesses 
‘_ VII. Feeling of Success 
be VIII. Distribution of ESP Ability 
IX. Effect of General Fatigue on ESP 
X. Role of Agent 
y= XI. Hypnotism and Suggestion 
Ly XII. Condition of Stimulus Material 
i- XIII. Distance, Time, and Barriers (Physical) 
it XIY. Novelty of Materials and Situations 
XV. Drugs 
XVI. Training (Learning) 
ge XVII. Role of Experimenter 
; XVIII. Volition 
XIX. Observers 
: XX. Rhythm 
te XXI. "Action 
XXII. Blindness 


ee bo 
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[Ae 


/ 6. 


8. 


I. FREEDOM, PLEASURE, EXCITEMENT, AND INTEREST 


Barrett 
(a) 


Brugmans 


Creery 


Dessoir 


Estabrooks 


Gibson 


Guthrie 


Lodge 


MacFarland 


eeeebdut of the favourable effect 
of freedom from constraint and of a 
spice of pleasurable excitement, we can 
speak with entire assurance. 


I believe that the best results 
with the two-room situation are a con- 
sequence of less inhibition. 


»++eand when the children were in 
good humour, and excited by the wonder- 
ful nature of their successful guessing, 
they very seldom made a mistake. 


eeeethe agent must be in sympathy 
with him (the subject), and must hin- 
self have the knack of conducting the 
experiments easily and pleasantly. 


A fundamental point is the ability 
to get in quick and friendly rapport 
with the subjects and put them at their 
ease as to the experiment, a subject 
who is nervous or hypercritical or cov- 
ertly hostile is worse than no subject 
at all. 


No. 4 brought a more intense in- 
terest into his experimentation as time 
went on and he was inclined to be either 
enthusiastic or discouraged by the ten- 
dencies of his scoring. 


+e+eeand as the novelty and vivacity 
of our seances has departed there is not 
the same geniality and freshness as at 
the outset. The thing has become mono- 
tonous, whereas it was formerly a suc- 
cession of surprises. 


I asked Miss E. what she felt when 
impressions were coming freely, and she 


said she felt a sort of influence or 
thrill. 


eeeeOne conclusion that is evident 
is that the mere desire to succeed as an 
ESP experimenter is not enough. 
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10. 


11. 


12. 


13. 


14. 


15. 


16. 


17. 


18. 


Price and 
Pegram 


Rhine, J.B. 
(a) 


(b) 


Rhine, L.E. 


Richet 


Schmoll & 
Mabire 


The atmosphere during the whole ex- 
periment was kept as informal as possi- 
ble. The subjects viewed the experiment 
as a game in which each wished to do as 
well as he could. 


ESP may run consistently below 
chance expectation if there is unconsci-.— 
ous (and, of course, if there be con- 
scious) negative tendency of sufficient 
strength. 


Encouragement is usually helpful. 
Light humors and moods are the best in 
which to work at ESP. 


The "curves of operation" found are 
probably motivational in origin. There , 
is evidence that interest, effort and at- 
tention vary, and cause results to vary; 
there is no clear evidence yet that ESP 
ability per se varies. 


One of the most striking similarities 
between extra-sensory perception and 
other difficult mental processes is the 
need in the case of both for confidence. 


eeesethe evident importance for suc- 
cess of psychological setting and "atmos- 
phere" leads one to suspect that a fail- 
ure may be relative, and may simply be a 
case of difficulty in finding the most 
favorable set of conditions. This point, 
however, is intended as a suggestion and 
not as an argument. 


In general the children's highest 
scoring occurred when the conditions ap- 
proximated most nearly those which ob- 
tained in their spontaneous play. 


If they seek for lucidity they will 
not find it..... The answers should come 
spontaneously and involuntarily.... 


It is also indispensable that those 
who take part in the experiments should 
not be predisposed toward any plan or 
theory; that they should interpret the 
results without bias, but also without 
exaggerated scepticism; that they should 
be animated by a sincere desire to dis- 
cover truth, whatever it may be..... 





62 


JOURNAL OF PARAPSYCHOLOGY 





19. Sidgwick 
and 
Johnson 


20. Tyrrell 
(b) 


21. Woodruff 
and 
George 


22. “ 


23. Van Loon 
and 
Weinberg 


Experiments of this kind (distance) 
were generally much more wearisome than 
those at closer quarters, especially as 
most of them were timed by watches.... 
and this....entailed a good deal of tire- 
some waiting on the part of the percipi- 
ent and of tediously prolonged thinking 
of the number on the part of the agent, 


Experience shows that the occurrence 
of these brief periods of dissociation 
(with high scoring) depends upon a psycho- 
logical background which is largely un- 
known; but that it is influenced by (i) 
ideas or suggestions which have been ac- 
cepted by the subject's subliminal and 
have taken root in it....(ii) By a gener- 
al emotional state including interest, 
enthusiasm, and happiness on the one hand 
or disappointment, depression and boredom 
on the other. (iii) By the subject's 
state of health, which must be good if the 
right psychological state is to supervene 
ooee That the external conditions of the 
experiments should include: (i) The possi- 
bility of working at a high rate of speed 
for two reasons, (a) to allow the para- 
normal impulse to run the gauntlet of con- 
scious associations .... (b) to avoid te- 
dium. (ii) The possibility of dealing 
rapidly with large numbers of trials in a 
way which makes the minimum demand on the 
conscious attention of the subject..... 
That it is necessary for the investigator 
to deal with every subject individually 


and not to attempt to treat subjects en 
masse. 


-eeethere is some evidence that at 
least certain subjects do not respond 
directly to small rewards in ESP tests. 


eeeethe ability to perform under dif- 
ferent conditions varies widely and in 
different directions among individuals. 


Emotional processes of consciousness 
are more easily transmitted than others 
for those sensations that make the strong- 
est impression on the agent are most eas- 
ily transferred. 
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24. 


II 
25. 


26. 


27. 


28. 
29. 


30. 


31. 


32. 


Verrall, 
Mrs. A.W. 


The extreme difficulty in keeping up 
any interest in this "very dull game" may 
account for the failure of the experiments 
oeee-She was keenly anxious to be success- 
ful and correspondingly depressed at fail- 
ure. 


. DISPOSITION, MOOD, PERSONALITY (INCLUDING HEALTH). 


Barrett 
(a) 


(c) 


Bond 


Creery 


Dessoir 


Drake 


Estabrooks 


Gibson 


A still more interesting and impor- 
tant question concerns such conditions of 
success and failure as may lie in the 
circumstances, disposition, general capa- 
city, and mood of the subject, including 
such points as consanguinity and famili- 
arity with members of the circle, and also 
in the temper and manner of the latter. 


In fact, when we made the experiments 
as amusing as possible, we had the great- 
est SUCCESS...- 


No reliable correlation between scor- 
ing ability and intelligence rating was 
found. 


(See Item 3) 


The percipient must be in a calm and 
contented frame of mind;.... 


While the cause of this general de- 
cline in scoring can be only speculated 
upon, it is interesting to note, in the 
light of the observations by Riess, con- 
cerning a hyperthyroid subject, that the 
subject's thyroxin dosage had been dou- 
bled a short time before. 


The very best type of subject is the 
one who regards both you and the experi- 
ment as a nuisance only to be endured for 
the sake of gratifying curiosity or for 
the sake of certain other inducements. 


Following a period of illness her 
work dropped to chance. It quickly rose 
+ gill and continued at a significant 
ra Cores 
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33. Gurney, Questions of mood, of goodwill, of 

Myers,and familiarity, may hold the same place in 

Podmore psychical investigation as questions of 
temperature in a physical laboratory. 


34. Osty The best output is obtained when the 
percipient is morally quiet, in the best 
possible health, and if the experiment is 
confined to those times when the subject 
feels most disposed to work. 


35. " «eee the weather, insufficient sleep, 
some unpleasant news, vexation, slight di- 
gestive difficulty--any of these little 
things may produce psychic trouble suffici- 
ent to vary the metagnomic faculty from 
day to day quite disproportionately to the 


cause. 
36. Rhine, J.B. eee the definite volitional control 
(a) over ESP shown by all percipients, the 


large role of effort and voluntary atten- 
tion apparent in all .... tend .... to 
make ESP a part of the natural organiza- 
tion of the‘species. ESP is directed by 
the conation of the percipient, and inte- 
grates naturally with the other cognitive 
and with the affective processes of the 
percipient's mind. 


—_° (See Item 12) 


38. Richet Each subject has his own personal 
psychology. If we desired to apply to all 
the same experimental mode, failure would 
very often result. 


39. Riess Her (Miss S.'s) medical record is of 
some interest in view of the fact that she 
gave, as excuse for the lapse of time be- 
tween the two series of trials, the state- 
ment that she had had a "nervous break=- 
down." Her physician .... gave the fol- 
lowing report on her condition. He said 
that she had had a condition of hyperthy- 
roidism of long standing which he was 
treating and for which he had prescribed 
treatment during the three month interval 
between series..... Miss S. seemed to be 
@ young lady of high intelligence and lin- 
ited interests. She was obviously not 
well adjusted to her life in the community. 
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40. 


41. 


42. 


43. 


44. 


45. 


46. 


Schrenck- 
Notzing 


Shulman 


Sidgwick 
and 
Johnson 


Thaw 


Tischner 


Tyrrell 
(bd) 


(c) 


Verrall, 
Mrs. A.W. 


On the whole, I have convinced my- 
self that persons who are very suggest- 
ible, in whom imagination is active, and 
particularly those of slightly hysterical 
temperament, are more suitable as percipi- 
ents than others. 


Therefore,.... it seems permissible 
to suggest that a clue to the reasons for 
the significant difference between these 
two groups (manic-depressive depressed 
and involutional melancholia) as they 
scored in this study may be found in the 
difference in degree of effective atten- 
tion, external interest, inversion of 
"thinking and feeling," and negativistic 
reactions. 


The reason of the failure is diffi- 
cult to surmise, unless it was the effect 
of the distance on the imagination of the 
agent or the percipient... 


If a percipient.can be put in the 
right condition by a word or two, or by 4 
moment's pressure on the forehead, as in 
the cases here mentioned,.... 


oeee and then H. was in very good 
condition; his health had improved and 
financial difficulties which had been 
weighing upon him had come to an end. 


(See Item 20) 


I can only say in the most general 
terms that the main condition seems to me 
to be that of mental and physical well- 
being; the faculty goes with health and 
happiness, and an absence of any condi- 
tions tending to self-consciousness..... 
joie de vivre. 


(See Item 24) 
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47. 


48. 


49. 


50. 
51. 


52. 


III. VARIATION AND DECLINE OF ESP ABILITY 


Barrett 
(a) 


Comm. on 
Thought 
Transfer- 
ence II 


Comm. on 


T. T. III 


Drake 


Gibson 


Guthrie. 
(b) 


The delicacy of the conditions was 
illustrated in our own inquiry partly by 
the inexplicable fluctuations of success 
and failure affecting the whole household, 
partly by the wide difference observed in 
the capacities of particular members of 
it from day to day. 


e+eethe average of success in the 
above experiments, though far above what 
chance alone could have supplied, falls 
considerably below the level attained in 
the trials with the children which were 
described in Part I of our Proceedings: 
and .... this decline in power equally 
showed itself whether the remaining men~ 
bers of the Creery family were or were not 
cognisant of the object to be guessed. 
The fact seems to be .... that the. capacity 
is gradually leaving them - a fresh illus- 
tration of the fleeting character which 
seems to attach to this and other forms 
of abnormal sensitiveness. 


It may be noted that the power of 
these children, collectively or separately, 
gradually diminished during these months, 
so that at the end of 1882 they could not 
do, under the easiest conditions, what 
they could do under the most stringent in 
1881. This gradual decline of power 
seemed quite independent of the tests ap- 
plied, and resembled the disappearance of 
a transitory pathological condition, being 
the very opposite of what might have been 
expected from a growing proficiency in 
code-communication. 


(See Item 30) 


In the case of the principle subject 
+e+ethere is a remarkable evenness in re- 
sponse to the various experimental pro- 
cedures and a regularity and consistency 
which is sustained through a long series 
of experiments running over two years. 


I have noticed a falling off in the 
facility and success of our experiments 
Since our first great results were obtained. 
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I do not know to what cause to attribute 
this declension. 


53. Jephson On the evidence of these curves, if 


54. 


55. 
56. 


57. 


58. 


59. 


60. 
61. 


we assume that they are genuine, it does 
look as if the "fatigue" element became 
less marked when the clairvoyant faculty 
is stronger, but it is obviously impossi- 
ble to draw conclusions from so small a 
number. 

I consider this definite drop from 
first sets to last sets in the total re- 
sults----reinforces very strongly the hy- 
pothesis put forward, that we are here 
observing at work, and progressively dete- 
riorating, an unknown faculty of percep- 


tion. 

Osty But besides persistent moral and or- 
ganic causes which may bring about per- 
sistent weakening of metagnomic faculty, 
this faculty is found to vary from day to 
day and even from hour to hour.... 

(See Item 34) 
Pratt One subject has been discovered who 
(a) has given extra-chance scores through many 
thousands of trials, showing, however, a 
gradual decline to a chance level of scor- 
ing. 

Pratt and (See Item 170) 

Woodruff 

Rhine, J.B. The loss of ESP ability with long use 

(a) is the exception rather than the rule. The 
ability may decline and return. It may 
also decline with the daily run. 

(b) Capacity for ESP declines when inter- 
est declines. 

(See Items 13 and 74) 
Richet Cryptesthesia appears without anyone 


knowing either why or how. It disappears 
the same way. It is inapprehensible. We 
do not know its premises. It is impossi- 
ble to foresee its destiny. It is very 
deceptive, but it is a fact. 
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62. 
63. 


64. 


65. 


66.. 


67. 


68. 


69. 


70. 


71. 


Tyrrell 
(a) 


Verrall, 
Mrs. A.W. 


Wales 


Warcollier 


(See Item 38) 


On the other hand, when the sensi- 
tive is engaged in the ordinary occupa- 
tions of life, telepathy seems sometimes 
to occur spontaneously.... 


(See Item 24) 


I have noticed some tendency to 
periodicity in the occurrence of Miss 
Samuels's veridical impressions. Many 
days have sometimes passed without any- 
thing cropping up in the notes that was 
applicable to me; at other times, two or 
three striking correspondences have come 
close together, even in the same set of 
notes. 


The phenomena of elementary tele- 
pathy which we have been able to produce 
appear to us to be as independent of the 
humas will as are all the other phenomena 
of nature. 


IV. ABSTRACTION, RELAXATION, AND CONCENTRATION 


Barrett 


(a) 


(c) 


Brugmans 


Despard- 


Campbell 


Dessoir 


The common notion that simplicity, 
and even comparative blankness of mind, 
are important conditions, seems somewhat 
doubtfully borne out by our experience. 


A passive condition of both trans- 
mitter and receiver in telepathy seems 
essential, so far at least as their con- 
sciousness is concerned. 


Our subject says that it is neces- 
sary that he empty his consciousness 
(that is his own expression), that it be 
empty. 


Further, the percipient found she 
could do better by removing her glasses 
and closing her eyes, as she was not then 
distracted by outside objects. 


The percipient .... must endeavor 
above everything not to strain expectation 
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72. Osty 


"9, Rhine, J.B. 
(a) 


75. (b) 


76. ° 


77. Schmoll & 
Mabire 


78. Sinclair 


in looking for the emergence of the image, 
but simply to wait quietly. He should 
empty his brain .... and gaze with closed 
eyes into a deep darkness. 


(See Item 34) 


Good abstraction is required for 
success in most percipients, along with 
effort and attention to the task; in a 
word, "concentration." 


New changes in procedure may disturb 
this for a time. 


Conflict of purposes (and, of course, 
emotions) spoils concentration. 


Dissociation lowers, along with other 
functions, the capacity to concentrate. 


Loss of ESP ability by an occasional 
subject may be due to incapacitation for 
the necessary abstraction under the con- 
ditions, rather than a loss of the ESP 
function itself. 


«eee our chief problem is to get the 
subject to let go of his natural inhibi- 
tions, his mental habits that are so 
bound up with rational and sensory pro- 
cesses. 


(See Items 12, 13) 


We would name three conditions as 
essential to satisfactory experiments: - 
(1) Absolute silence. (2) On the part of 
the agents: concentration of thoughts and 
Jooks on the objects to be guessed, and 
firm determination that it shall impress 
itself upon the percipient's mental vi- 
sion. (3) On the part of the percipient: 
complete covering of the eyes, but on no 
account pressure upon them; perfect calm 
and an easy position. 


The next step, after having turned 
off the light and closed your eyes and 
relaxed mind and body.....Now, completely 
relaxed, hold your mind a blank again. 
Hold it so for a few moments, then give 
the mental order to the unconscious mind 
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79. 


80. 


81. 
82. 


83. 


84. 


85. 


86. 
87. 


Thomas 


Tyrrell 
(c) 


Usher and 
Burt 


Warcollier 


Woodruff 
and 
George 


Bender 


Despard 


Dessoir 


to tell you what is on the paper you hold 
in your hand. 


eeee that is to say, make their minds 
as much a blank as possible and guess 
whatever comes into their heads after the 
signal has been given. 


G.J. is quite definitely aware,...,. 
of almost losing consciousness of her 
surroundings. She says that a peculiar, 
and rather exalted feeling comes over 
her, waking her feel that it is almost 
impossible to fail, and so long as this 
lasts, the successes follow one another 
in an almost unbroken chain; but it is 
never maintained for more than a few se- 
conds at a time. One sees here a kind of 
mental dissociation....which lets the 
extra-sensory faculty overcome its custon- 
ary inhibitions for a moment or two. 


(See Item 20) 


His method of procedure was as fol- 
lows:....-he....sat down at a table en- 
deavoring to make his mind a blank. 


One must create in oneself a void of 
thought, keeping the attention solely upon 
the one idea of visualization. 


It seems safe to say that with the 
subjects here used, conscious attention 
is important, though not essential, in 
the efficient operation of this principle, 


VY. DISTRACTION 


The presence of an observer materi- 
ally reduced the number of hits. 


(See Item 70) 


The preliminary conditions of a suc- 
cessful sitting appear to me to be:- A 
very quiet locality, with plenty of fresh 
air and a moderate temperature.... 
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88. 


89. 
90. 
91. 


92. 
93. 


94. 


95. 
96. 


97. 


98. 


Gibson 


During this experiment....he.... 
seemed (to be in) a semi-dissociated 
state. 


Gurney et al (See Item 33) 


Guthrie 
Lodge 


Osty 


Rhine,J.B. 
(a) 


(b) 


Schmoll & 
Mabire 


Schrenck- 
Notzing 


(See Item 7) 


»oeedut they should be tried soberly 
and quietly, like any other experiment. 
A public platform is a most unsuitable 
place; and nothing tried before 


(See Item 35) 


There are many facts supporting a 
view that ESP is easily encroached upon 
by rational and sensory processes, and 
that the delicate balance required for 
good ESP may be concerned chiefly with 
the maintainance of the field of attention 
free from these encroachments. 


There is apparently no surer way of 
bringing down ESP scores than by causing 
nervous dissociation. Whether this dis- 
sociation is the result of narcotic 
drugs, extreme fatigue, or sleepiness does 
not matter. 


(See Items 73, 74) 


Eugenie P: "I do my best to banish 
any thought that might distract me, and 
I watch for the appearance. It is not al- 
ways possible for me quite to renounce 
thought and volition." 


Thus the agents have....to guard 
against extraneous thoughts which would 
distract them from their mental labour; 
while the percipient on his side, can- 
not sufficiently guard against all cere- 
bral activity; he must carefully deny all 
free range to his ideas and imagination, 
and concentrate his endeavours on seizing 
the impressions or completing the rudi- 
ments of those which present themselves 
to his mental vision. 


The psychical process is comparable 
to artistic activity. Under the dissect- 
ing knife of scientific analysis no ar- 
tistic creation would be possible: it 
needs the undisturbed quiet of the studio. 
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99. Sidgwick 
& Johnson 


100. Tischner 


101. Barrett 
102. Bender 


103. Creery 


104. Dessoir 


105. Guthrie 
(a) 


106 ‘ " 


107. Lodge 


109. Rhine 





(See Items 19 & 42) 


(See Item 44) 


VI. WITNESSES 
(See Item 25) 


The presence of an observer material- 
ly reduced the number of hits. 


Our worst experiments before strang- 
ers have invariably been when the company 
was dull and undemonstrative.... 


Only persons ought to take part in 
the experiments whose presence is agree- 
able to the percipient, and who he knows 
will not be disturbed or annoyed by occa- 
sional failure. 


It would appear that any mental dis- 
turbance on the part of the operators or 
on the part of the "subjects," due to anxi- 
ety to succeed, or to the novelty of the 
entourage of persons or things, very much 
interferes with the success of experiments, 


eoee the previous failure having 
been probably due to the mind of the agent 
occupying itself with the presence of the 
visitor, instead of being directed exclu- 
sively upon the object to be described. 


Usually the presence of a stranger 
spoils the phenomena, though in some cases 
a stranger has proved a good agent straight 
off. 


It is not even necessary that any 
antagonism should be manifested. The an- 
tipathy of a percipient for some other 
person is sometimes intuitive and reacts 
on the psychic faculty. A few more sé- 
ances generally allow of this repulsion 
being overcome. 


(See Item 73) 
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110. Sidgwick The least disturbance of our customa- 
ry method, change of time or place, pres- 
ence of strangers, controversy, and expe- 
cially noise, is apt to make things go 


wrong. 
111. Tyrrell But some of the conditions are psy- 
(c) chological, very delicate, and largely 


unknown. Much depends on atmosphere; and, 
after all, extra-sensory perception is not 
the only thing which is dependent on at- 
mosphere. 


112. Gurney, It must be remembered that we were 
Myers & dealing, not with chemical substances, but 
Podmore with youthful minds, liable to be reduced 

to confusion by anything in the demeanor 
i visitors which inspired distaste or 
alarm.... 


VII. FEELING OF SUCCESS 


113. Adams ee+eeit would seem that there is no 
high correlation between subjective cer- 
i- tainty and success in attempted ESP. 
114. Creery (See Item 3) 
Se 115. Gurney, It is almost inevitable that a per- 
Myers & cipient who has aroused interest by a 


should feel in a way responsible for fur- 
ther results; and yet any real pre-occupa- 
tion with such an idea seems likely to be 


t | Podmore marked success on several occasions, 


fatal. 
| 116. Jephson I should expect my group of subjects 
nt of being more clairvoyant than the normal 


»eeelikely to have had previous experi- 
ence of clairvoyance and so possibly a bias 
towards success. 


117. Lodge With regard to the feelings of the 
percipients when receiving an impression, 
they seem to have some sort of conscious- 
ness of the action of other minds on them; 
and once or twice, when not so conscious, 

} have complained that there seemed to be 

"no power" or any thing acting, and that 

they not only received no impression, but 

did not feel as if they were going to. 
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118. 


119. 


120. 


121. 


122. 
123. 


124. 


125. 


126. 


127. 


Richet 


Riess 


Schmoll 
and 
Mabire 


Sinclair 


Tyrrell 


Verrall, 
Mrs. Bi@e 


Sometimes they seem quite certain 
that they are right. Occasionally Miss 
E. has been pretty confident and yet quite 
wrong. 


Let us not be disheartened, but pa- 
tient and persevering if the experiments 
are negative at the start. 


She said that she did not believe 
that there was any difference in scores 
although she was much less curious about 
the scores than in the former series. 


+eeeand resolved to throw into the 
work the energy that does not recoil in 
the fact of difficulty,.... and the pa- 
tience that is not discouraged by a fail- 
ure, or a whole series of failures. 


"When the true visions came, there 
usually came with them a ‘something' which 
I call a ‘hunch'." 


(See Item 80) 
(See Item 24) 


VIII. DISTRIBUTION OF ESP ABILITY 


Adams 


Comm. on 
Fo Be SS 


Creery 


Guthrie 
(b) 


Published estimates that one person 
in five has ESP ability seem far too high 
in the light of these experiments. Here 
seventy subjects were tested, none of whom 
was able to demonstrate the ability in 
question. 


«+eewe find the capacity present, to 
a degree admitting of valuable experiment, 
in a far larger number of persons than we 
had at first supposed. 


I may say that this faculty is not by 
any means confined to members of one fan- 
ily; it is much more general than we in- 
agine. 


I have been, I need hardly say, very 
anxious to find additional cases of 
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percipiency, and I have induced quite a 
number of people to make trials in this 
direction, but hitherto without any satis- 
factory result. 


128. Kubis and These physical differences (in twins) 
Rouke would warrant further investigation of 
the relations of temperament and intel- 
ligence to extra-sensory powers. 


129. Price and Forty-four per cent of the (66) sub- 
Pegram jects gave individually significant scores. 
130. Rhine, J.B. It seems favorably suggested, at 
(a) least, that ESP may be heritable or per- 
haps its more common inhibiting factors 
may be. 
191. Rhine,L.E. The occurrence of ESP is again demon- 


strated, in this case....with 17 children 
aged from three to fifteen. 


132. Schrenck- The power does not appear to be so 
Notzing rare as is believed; the difficulty lies 
rather in seizing the moment when such 
persons are in the right mood. 


IX. EFFECT OF GENERAL FATIGUE ON ESP 


133. Estabrooks Using this particular technique it 
would appear that the faculty which under- 
lies it is extremely susceptible to fa- 
tigue, that it works best with a minimum 
of conscious interference and that any 
strain or excitement on the part of the 
percipient is a pretty certain indication 
of failure. 


134. Jephson (See Item 59) 


185. Kubis and The factor of fatigue must be avoid- 
Rouke ed, since it seems detrimental to tele- 
pathic phenomena. 


136. Lodge. The percipients complain of no fa- 
tigue as induced by the experiments, and 
I have no reason to suppose that any harm 
is done them. The agent, on the other 
hand, if very energetic, is liable to 
contract a headache;.... 
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137. 
138. 


139. 
140. 


141. 


142. 
143. 


144, 
145. 


146. 


Osty (See Item 34, 35) 


Pegram The rate of scoring was found to be 
independent of the number of runs per- 
formed each period.....and.... the very 
last runs of the day had the highest aver- 
age scores. 


Pareto ESP is not easily fatigued. 
& 


Tyrrell She had to get herself into a state 
(a) of great tension, and the number, when it 
came, was uttered explosively, as it 
might be by someone who was making a great 
muscular effort. After giving four or 
five cards she was aanalie exhausted.... 


X. ROLE OF AGENT 


Creery eeeewe are all convinced that when 
mistakes are made the fault rests, for 
the most part, with the thinkers, rather 
than with the thought-readers. 


Dessoir (See Item 4) 


Guthrie I may here remark that the results 
of our experience is that success or fail- 
ure depends as much (if not more) upon 
the condition of the agent as upon that 
of the percipient..... When I have not 
felt equal to the required effort of con- 
centration, I have been unable to repeat 
the success. 


MacFarland (See Item 9) 


Schmoll & (See Item 77) 
Mabire 


Warcollier From among our best percipients we 
chose the person who was to act as agent. 
She relaxed into the passive state, the 
usual state for perciptents. 


. Gibotteaus says that one must think 
of the matter to be transmitted, and then 
release it suddenly. "As agent," he says, 
"one must discharge one's own mind." 
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XI. HYPNOTISM AND SUGGESTION 


148. Barrett We could find no resemblance between 
(a) these phenomena and those known as mes- 
meric; inasmuch as a perfectly normal state 
on the part of the subject seemed our 
first pre-requisite. 


149. (b) When the subject was in the state of 
trance or profound hypnotism, I noticed 
that not only sensations but also ideas or 
emotions occurring in the operator appeared 
to be reproduced in the subject without 
the intervention of any sign, or visible 
or audible communication. 


150. Miles and There is another point which I do not 
Ramsden remember to have heard discussed and that 
is the influence of suggestion as an aid 
to the development of psychic faculties. 
I have found it very effective in my own 
case. 


151. Rhine,J.B. eeeewe found that we did not need to 
use the (hypnotic) trance, that it did not 
help and, of course, made the work much 
more laborious. 


152. Rhine,L.E. It has become increasingly apparent 
to many ESP workers that suggestion can 
play an immense part in the outcome of 
tests of ESP. Unless guarded against with 
extreme care it can do much to confuse the 
issue and obscure the true situation. 


153. Schrenck-(See Item 40) 
Notzing 


154. Thaw (See Item 43) 


XII. CONDITION OF STIMULUS MATERIAL 


155. Carpenter For a subject who can guess cards 
and with scores beyond chance expectancy, color 
Phalen stimuli are as effective as form stimuli. 


156. MacFarland It was found that when cards remain 
and unshuffled for a considerable period of 
George time before being used in a test series 

the scores of subj 


ects will be higher 
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157. MacFarland 
and 
George 


158. Pratt & 
Woodruff 


159. " 
160. Rhine,L.E. 


161. “4 


than when they are shuffled immediately 
preceding the series. This is offered, 
however, only as a further problem and in 
no sense as an established generalization, 


A comparison of scores obtained when 
normal and distorted material is used, 
indicates a small difference in favor of 
normal material largely contributed by 
two subjects. Even though inconclusive, 
this would indicate the importance of 
further attention to situations in which 
"preference" might be expected to play a 
more important part. 


Analysis of the data according to 
size of stimulus symbols used showed that 
size per se did not affect the results of 
the investigation as a whole. 


(See Item 170) 


Within the scope of the experimenta- 
tion herein reported size variations 
ranging to proportions of 2,704 to 1 in 
stimuli did not result in a significant 
preference in scoring. 


Variations in number of stimuli pre- 
sented 5 to 1 at a given time did not re- 
sult in a significant preference. 


XIII. DISTANCE, TIME, AND BARRIERS (PHYSICAL) 


162. Barrett 
(a) 


168. (c) 


Another question would be as to the 
effect of greater or less distance be- 
tween the sitters and the guesser, and of 
obstacles. It will have been seen that, 
eeeethe intervention of a door or wall 
or wall seemed to make no difference. 


Another fact which seems to me 
brought out very clearly in our experi- 
ments is that psychical phenomena, wheth- 
er of telepathy, clairvoyance, or the 
higher phenomena of spiritualism, are 
manifestations of, or through, the trans- 
cendental self of the subject, and are 
therefore independent of the fundamental 
units of the physical world-matter, time 
and space. 
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164. 


165. 


166. 


167. 


168. 


169. 


170. 


Brugmans But in any case, a greater distance 
does not lessen the phenomenon. 
Rhine ++eeimprovement is shown....uniform- 

(a) ly with distance, (i.e., when complete 
failure does not attend it.) Distance 
discourages sensory attention and would 
aid abstraction. 

(c) eoeebdut the evidence that it (dist- 
ance) does not influence it (ESP) is nev- 
ertheless considerable..... the work al- 
ready reported seems to show that dist- 
ance does not limit ESP as it does sens- 
ory perception. 

Sidgwick We were extremely anxious to succeed 
and with agent and percipient at greater dist- 
Johnson ances....but we obtained practically no 
success. 
XIV. NOVELTY OF MATERIALS AND SITUATIONS 
Estabrooks It was found that using playing cards, 
a person very rapidly acquired certain 
habits which were fatal to the experiment. 
Guthrie (See Item 7) 
(b) 
Pratt and When the results were considered in 
Woodruff relation to the amount of subjects' experi- 


ence with the different kinds (sizes) of 
stimulus material, subjects were found to 
score significantly better with new than 
with old material. The advantage of work- 
ing with new material was found to de- 
cline after a time as the subjects became 
more experienced with the new material. 
Experienced and inexperienced subjects 
scored equally well with new material. 
When subjects did not know before or during 
& run what size of stimuli were used, the 
advantage in favor of higher scores with 
new material was not statistically signi- 
ficant. The evidence suggests that there 
was @ period of adjustment during the 
first runs in the first sessions of using 
any material, whether new or old. 
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171. 


172. 
173. 


174. 


175. 


176. 


177. 


178. 
179. 


Rhine, J.B. 


Verrall, 
Mrs. A.W. 


Brugmans 


Rhine,J.B. 


Tanagras 


Variation of the procedure, without 
introducing new changes, helps to keep up 
the scoring level. 


(See Item 73) 
(See Item 24) 


XV. DRUGS 


As for the alcohol, we can say that 
it augments the results considerably. 


Dissociative drugs, sleepiness and 
certain illnesses work to lower this in- 
tegration and self-control; whereas drugs 
that antagonize dissociative drugs help 
to recover normal control. And in our 
results the data show plainly that dis- 
sociative factors likewise lower ESP 
ability, while counteractive factors help 
to restore it. 


The effect of sodium amytal has been 
rather strikingly destructive to ESP..., 


eeeethe effect of caffeine was equal- 
ly striking. The first treatment brought 
his average up from 12.8 to 14.7 in 300 
trials..... But the best test for caffeine 
came 5 hours after taking the sodium anytal. 
Under the influence of the amytal he had 
dropped to an average of 6.2 in the last 
300 trials. One hour after the 5-gr. dose 
of caffeine, he rose to an average of 9.5 


(See Item 94) 


It is evident that, in this circun- 
stance, the player, finding himself, 
thanks to the champagne, in a light "Ab- 
sence," emitted psychological energy.... 
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180. 


181. 


182. 


183. 


184. 


185. 


186, 


187. 


Pratt and 
Woodruff 


Richet 


Rhine 
(a) 


Warcollier 


XVI. TRAINING (LEARNING) 


The amount of experience of subjects 
with ESP tests was not, in itself, di- 
rectly associated with trends in scoring. 


(See Item 170) 


I believe that all our efforts to in- 
tensify this faculty in a sensitive are 
barren and even sometimes disastrous.... 


Improvement in ESP is limited, usual- 
ly to a short initial period; and this 
may be purely a matter of learning to 
abstract and achieve good concentration, 
There is no good evidence of improvement 
of the ability. A level seems to be 
reached and not far exceeded. When it is 
exceeded for particular runs, it seems to 
be through special effort. 


Briefly, the lesson learned from these 
experiments in telepathy is that no tele- 
pathic training is possible for percipi- 
ents, except for them to develop their 
imagination to permit the telepathic mes- 
sage to manifest itself. 


XVII. ROLE OF EXPERIMENTER 


MacFarland 


Pratt and 
Price 


Sharp and 
Clark 





But the two experimenters still con- 
tinued at approximately their previous 
levels of success, one at chance and the 
other consistently above. 


The research shows only that if dif- 
ferences in personality were responsible 
for the results, they were at least not 
dependent on direct contact with subjects 
during the tests; experimenters and sub- 
jects had no such personal contact. 


The writers conclude that failure to 
find evidence for ESP in card tests may 
be due to au unfavorable experimenter- 
subject relationship. 


It was observed that marked variation 
in group scoring coincided with changes 
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188. 


189. 


190. 
191. 


192. 


193. 
194. 


195. 


196. 


Sharp and 
Clark 


Pegram 


Rhine 


in the experimenter's attitude. Individu- 
al scoring showed notable changes with 
different experimenters. 


During these weeks the experimenter 
was working, then, with divided attention 
(His wife was ill.)..... It is interesting 
to note that each week under "norma]" 
conditions gave a positive deviation; each 
"abnormal" week, a negative one. 


XVIII. VOLITION 


Low-aim showed more consistent devia- 
tions from chance than did high-aim. 


(See Item 36) 


Warcollier(See Item 66) 


Barrett 
(a) 


Dessoir 
Rhine 


Barrett 
(a) 


Stuart 


XIX. OBSERVERS 


It would be interesting, again, to 
discover whether numerical increase in the 
observers increases the effect, and how 
far the presence of the father....seemed 
decidedly to increase the percentage of 
successes. 


(See Item 87) 
(See Item 73) 


XX. RHYTHM 


On one or two occasions it seemed of 
advantage to obtain vivid simultaneous 
realisation of the desired word on the part 
of all the sitters; which is most easily 
effected if some one slowly and gently 
claps time, and all mentally summon up 
the word with the beats. 


It is suggested that the (highly sig- 
nificant) difference in scoring level 
noted is due to distraction of attention 
from the primary task of matching when 
imposed non-tempo rates require effort to 
keep in time. 
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197. Tyrrell Rhythm in working through a series 
of trials is desirable. 


XXI. ACTION 


198. Tyrrell (See Item 20) 


199. Verrall, The Misses Tipping are both under 
H. de G the impression that more success is like- 
ly to be attained when action of some 
kind is involved in the subject of the 
experiment, and the results hitherto ob- 
served in this case bear out this im- 
pression. 


XXII. BLINDNESS 


200. Price The average scores of the tests given 
the blind subjects are only slightly but 
fairly consistently higher than those ob- 
tained from the non-blind. 


201. Price and No reliable correlation was noted be- 
Pegram tween ESP scoring ability and age, extent 
of blindness, nor with the time in which 
the subject became blind. 


REFERENCES 


Adams, E.T. "A Summary of Some Negative Experiments, " 
J. Parapsychol., II (1938), 232-36. 

Barrett, W.F.. 

(a) "First Report on Thought Reading," Proc. S.P.R., 
I (1882), 13-34.. 

(b) "On Some Phenomena Associated with Abnormal Con- 
ditions of Mind," Proc. S.P.R., I (1883), 238-44. 
(c) "Some Reminiscences of Fifty Years' Psychic Re- 
search," Proc. S.P.R., XXXIV (1924), 275-97.. 

Bender, Hans. (Review by Adams, D.K.) "Bender on Extra- 
Sensory and Sensory Form Perception," J. Parapsy- 
chol., I (1937), 52-62.. 

Bond, Esther, "General Extra-Sensory Perception with a 
Group of Fourth and Fifth Grade Retarded Children," 
J. Parapsychol., I (1937), 114-22 








84 JOURNAL OF PARAPSYCHOLOGY 








Brugmans, H. I. F. W. “Une Communication sur des Experi- 
ences Telepathiques au Laboratoire de Psychologie 
& Groningue Faites par M. Heymans, Dr. Weinberg, et 
Dr. H. I. F. W. Brugmans, "Compte Renau Offictel du 
Premter Congrés International des Recherches Psy- 
chiques (1922), 396-408.. 

Carpenter, C. R. and Phalen, Harold R. "An Experiment 
in Card Guessing," J. Parapsychol., I (1937), 31-43. 

Committee on Thought Transference. "Second Report," 
Proc. S. P. R., I (1882), 70-98. 

"Third Report," Proc. S. P. R., I (1883), 161-216, 

Creery, A.M. "Note on Thought Reading," Proc. S. P. R., 
I (1882), 43-46. 

Despard, R. C. and Campbell, C. M. "Experiments in 
Thought Transference," J. S. P. R., VI (18(3), 4-9. 

Dessoir, Max. "Experiments in Muscle-Reading and Thought- 
Transference," Proc. S. P. R., IV (1886), 111-126. 

Drake, Raleigh M. "An Unusual Case of Extra-Sensory Per- 
ception," J. Parapsychol., II (1938), 184-98. 

Estabrooks, G. H. "A Contribution to Experimental Tele- 
pathy," Bull. Boston S. P. R. (1927). 

Gibson, E. P. "A Study in Comparative Performance in 
Several ESP Procedures," J. Parapsychol., I (1937) 
264-75. 

Gurney, Edmund; Myers, F. W. H.; and Podmore, F., Phan- 
—— of the Living. London: Trubner & Co., 2 vols., 
1886. 

Guthrie, Malcolm. 

(a) "An Account of Some Experiments in Thought Trans- 
ference," Proc. S. P. R., II (1883), 24-42. 

(b) "Further Report on Experiments in Thought Trans- 
ference at Liverpool," Proc. S. P. R., III (1885), 
424-52. 

Jephson, Ina. "Evidence for Clairvoyance in Card Guess- 
ing," Proc. S. P. R. XXXVIII (1929), 223-68. 

Kubis, J. F., and Rouke, F. L. "An Experimental Investi- 
gation of Telepathic Phenomena in Twins," J. Para- 
psychol., I (1937), 163-71. 

Lodge, Oliver J. "An Account of Some Experiments in 
Thought Transference," Proc. S. P. R., II (1884), 
189-200. 

MacFarland, J. D. "Discrimination Shown Between Experi- 
poker by Subjects," J. Parapsychol., II (1938), 
160-70. 
and George, R. W. "Extra-Sensory Perception of Nor- 
mal and Distorted Symbols," J. Parapsychol., I 
(1937), 93-101. 

Miles, Clarissa, and Ramsden, H. "Experiments in Thought 
Transference," Proc. S. P. R., XXI (1908), 60-93. 








Mu 
0s 
Pe 


Pr 


Pr 


Pr 


=] 


Si 


Si 








43, 


216, 
Ro, 


+ 


e- 
7) 

ls., 
ans- 


nSs- 


); 





CONDITIONS AFFECTING ESP PERFORMANCE 85 





Murray, Gilbert. "Pres. Address," Proc. S. P. R., XXIX 
(1918), 46-68. 

Osty, Eugene. Supernormal Faculttes tn Man. London: Meth- 
uen, 1923. 134-35. 

Pegram, Margaret H. "Psychological Relations of Extra- 
Sensory Perception," J. Parapsychol., I (1987), 
191-205. 

Pratt, J. G. 

(a) "Clairvoyant Blind Matching," J. Parapsychol., 
I (1937), 10-17. 

(b) "The Work of C. Hilton Rice," J. Parapsychol., 
I (1937), 239-59. 

, and Price, M. M. "The Experimenter-Subject Rela- 
tionship in Tests for ESP," J. Parapsychol., II 
(1938), 84-95. 

Pratt, J. G., and Woodruff, J. L. "Size of Stimulus in 
Extra-Sensory Perception," J. Parapsychol., III 
(1939), 121-58. 

Price, M. M. "A Comparison of Blind and Seeing Subjects 
in ESP Tests," J. Parapsychol., II (1938), 273-86. 
, and Pegram, M. H. "Extra-Sensory Perception Among 
the Blind," J. Parapaychol., 1 (1987), 149-55. 

Rhine, J. B. 

(a) Extra-Sensory Perception. Boston: Bruce Hun- 
phries, 1934. 

(b) New Frontters of the Mind. New York: Farrar and 
Rinehart, 1937. 

(c) "Effect of Distance in ESP Tests," J. Parapsy- 
chol., I (1987), 172-184. 

Rhine, L. E. "Some Stimulus Variations in Extra-Sensory 
Perception with Child Subjects," J. Parapsychol., 

I (1937), 102-113. 

Richet, _ Our Sixth Sense. London: Rider & Co., 
1927. 

Riess, B. F. "A Case of High Scores in Card Guessing at a 
Distance," J. Parapsychol., I (1987), 260-63. 

Schmoll, A., and Mabire, J. E. "Experiments in Thought 

‘Transference," Proc. S. P. R., V (1888), 169-215. 

Schrenck-Notzing, Baron von. "Experimental Studies in 

ee Proc. S. P. R., VII (1891), 
aa 2. 

Sharp, V., and Clark, C. C. "Group Tests for Extra-Sensory 
Perception, " J. Parapsychol., I (1937), 123-42. 
Shulman, Robert. "A Study of Card Guessing in Psychotic 
Subjects," J. Parapsychol., II (1938), 95-106. 
Sidgwick, Mrs. Henry. "Report on Further Experiments in 
Thought-Transference Carried out by Prof. Gilbert 
Murray," Proc. S. P. R., XXXIV (1924), 212-274. 

Sidgwick, Mrs. Henry, and Johnson, Alice. "Experiments in 
ye Transference," Proc. S.P.R., VIII (1892), 

-96. 





86 JOURNAL OF PARAPSYCHOLOGY 





Sinclair, Upton. Mental Radio. Pasadena: Upton Sin- 
clair, 1930. 

Stuart, C. E. "The Effect of Rate of Movement in Card 
Matching Tests of Extra-Sensory Perception," J. 
Parapsychol., II (1938), 171-183. 

Tanagras, A. Le Destin et la Chance. Société des Recher- 
ches Psychiques Hellenique: Athens, 1938. 

Thaw, A. Blair. "Some Experiments in Thought Transfer- 
ence," Proc. S. P. R., VIII (1892), 422-35. 

Thomas, N. W. Thought Transference. London: Alex Moring, 
Ltd. 1905.. 

Tischner, Rudolph. Telepathy and Clairvoyance. (Trans. 
by Hutchinson, W. D.) New York: Harcourt, Brace, 
1925. 

Tyrrell, G. N. Me. 

(a) "The Case of Miss Nancy Sinclair," Jour. S. P. 
R., XX (1922), 294-3827. 

(b) "Further Research in Extra-Sensory Perception," 
Proc. S. P. R., XLIV (1936), 99-168. 

(c) Science and Psychical Phenomena. New York: 
Harpers, 1938. 

Usher, F. L., and Burt, F. P. "Thought Transference, " 
Annals of Psychical Sctence, VIII (1909), 561-600 

Van Loon, F. H., and Weinberg, A.- A. "A Method of In- 
vestigation into Thought Transference," Jour. S. P. 
R., XX (1921), 34-49. 

Verrall, Mrs. A. W. "“Supernormal Acquisition of Know- 
ledge," Proc. S. P. R., XI (1895), 174-93. 

Verrall, H. De G. "Some Recent Experiments in Thought 
Transference," Proc. S. P. R., XXVII (1915), 415-457, 

Wales, Hubert. "Apparent Thought-Transference," Proc. S. 
P. R., XXXI (1921), 124-217. 

Warcollier, René. Fxperimental Telepathy. Boston: Boston 
S. P. Re, 1938.. 

Woodruff, J. L., and George, R. W. "Experiments in Extra- 
Sensory Perception," J. Parapsychol., I (1937), 
18-30. 








Boa 
Mem 


Sub 


and 
are 


S. 
vie 
the 


of 
tic 
tat 


of 
ing 


sio 
sat 
Woo 
whe 
to 

aff 
van 
pro 
whe 
car 


ext 
wit 


1, ( 


a . —_— =- | 








457. 
Ss. 


on 


ra- 





Board of Review, Journal of Parapsychology 
Memorandum to Dr. Gardner Murphy, Editor 


Subject: Review of "Experiments Bearing on the Precog- 
nition Hypothesis, III Mechanically 
Selected Cards," by J. B. Rhine 


This manuscript has been reviewed by the Board 

and the following members have submitted criticisms which 
are incorporated in this memorandum; E. R. Hilgard, 
R. R. Willoughby, I. Lorge, J. L. Kennedy, L. Long and 
§. B. Sells. Specific points are credited to each re- 
viewer; all other statements are the responsibility of 
the writer. 


The criticism covers the writing and organization 
of the report, the design of the experiment, the statis- 
tical method of evaluating the results and the interpre- 
tation. 


A. Writing and Organization of the Report: 


The report is poorly written from the standpoint 
of following the experimenter's trend of thought and keep- 
ing track of details of procedure and interpretation. 


Dr. Willoughby considers this paper a retrogres- 
sion on the part of the Duke Laboratory after the highly 
satisfactory reporting of their experiments by Pratt and 
Woodruff last year. "The style is back in the phase 
where you had to hunt through a maze of explanations as 
to whether it is preferable to believe that the subjects 
affected the shuffling by remote control or received ad- 
vance information as to what the shuffle was going to 
produce, etc. ...to locate such a critical point as 
whether they were trying to match or not to match the 
cards." 


Dr. Lorge has made a similar criticism. "It is 
extraordinarily difficult for a person not conversant 
with the literature to understand either the problem, the 





1. Certain of the detailed recommendations of the Board concerning 
the writing have been followed in the revised report. These are 
omitted from this memorandum, as indicated. The writer believes 
that the present revision is superior to the original in its pre- 
sentation. Unfortunately time did not permit consideration of 
the revision by the Board. (April 7, 1941) 
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procedure, or the conclusions. The paper is unduly ver- 
bose, vague and ambiguous. I recommend that Professor 
Rhine be advised to rewrite the paper in the form of hy- 
pothesis, justification for hypothesis, procedure neces- 
sary to test the hypothesis, description of procedure ex- 
actly with illustrative material so that a person not 
having had previous experience in this line of research 
might understand as he reads this paper, analysis of the 
data and conclusions, conclusions, however, to be direct- 
ed to the data from this study first and later integrated 
with such other relevant literature as the author deems 
advisable." And again. "Furthermore, data should be 
incorporated at the point of interest and not included 
as an appendix. This is an article, not a monograph." 


Dr. Lorge made a detailed list of criticisms of 
the organization of the paper. These have been careful- 
ly checked and are endorsed in toto by the writer. (The 
list originally included has been omitted by the writer 
Since most of the suggestions included have been incor- 
porated in the revision of the report. April 7, 1941. 
S. B. Sells) 


B. Design of the Experiment 


The design of the experiment has been criticized 
by every reviewer. Part of the criticism has been re- 
flected in the preceding statements concerning organiza- 
tion and writing. 


Dr. Hilgard points out the general laxity of pro- 
cedure. "The general arrangements, while admittedly not 
meeting all the requirements for independent records 
patric, for later checking, appear to be generally sat- 
isfactory. There is still an atmosphere of informality 
about arrangements, such as the author being called out 
of the experimental room to answer telephone calls 
(ms.p.6). Any "later" discrepancies as mentioned on 
p.-11(ms.) should be subject to review through examining 
original records, not through arbitrarily choosing a val- 
ue favoring the chance mean." 


Dr. Kennedy has reported that he observed no ob- 
vious experimental errors, but that he felt that failure 
to mention one condition of control throughout the ex- 
periment was a fault in technique. 


Dr. Long did not observe any serious omission in 
the experimental procedure. However, he criticized the 
design as follows: "The determination of the number of 
the correct responses by chance alone in this paper 
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seems to run into the same difficulty that has occurred 
before in ESP experiments. If chance is 5 in 25 then it 
must be assumed that there are 25 independent choices. 
Actually, this is not the case. With no screen or other 
sensory precautions it is obvious that the subject worked 
with knowledge of the numerical distribution of the 
cards. Certainly it is not difficult to believe that 
the subject would refrain from placing 6 cards in any 
one pile. Would it be possible to give a subject a pack 
of 25 cards and tell him to select only 5 cards? That 
is, he is to place only one card which is later to be 
matched with the key card. He can take the first 5 
cards or he can run through as many cards as he likes, 
but only five cards are to be placed out front. This 
would make the experiment a little longer and cut down 
on the N, but on the other hand Rhine seems to inflate 
the N by his procedure. In the suggested situation it 
seems that chance would definitely be 1 in 4 since the 
judgments are independent." 


Dr. Willoughby has raised a similar point. "We 
are led back to the point binomial and the square root 
of npq. It seems to me that the Huntington-Sterne and 
Kellogg contributions successfully replaced this approx- 
imation with the precisely appropriate distribution, at 
least for the standard situation. The situation now 
discussed seems to me not to be the standard one. In 
the standard situation the calls vary in a very large 
number of ways, in a number of ways limited by the hab- 
its of the subject, and the cards vary independently in 
the same number of ways; it was the achievement of the 
Huntington-Sterne group and of Kellogg to determine the 
proportion of each kind of combination that results from 
all possible associations of these two very large vari- 
ables. In the present situation the calls vary in some- 
thing like the same way--except that the habits of per- 
sons sorting cards into five groups are pretty certainly 
different from those of the same persons reporting on 
the images of these cards that occur to them--but it 
seems to me that the "cards," i.e., the target series of 
five to be determined by post-guessing shuffle, vary in 
only 5.4.3.2.1 or 120 ways. If this is correct, the 
chances of making a hit would be greatly increased. What 
we need, of course, is a distribution of the chances of 
making 9, 1, 2, 3...hits, and on the same axis a distri- 
bution of the hits actually made--whatever the correct 
chance distribution." 


One of the most important criticisms of the de- 
Sign of the experiment is what we may call its lack of 
design. Many different conditions are employed, 
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different subjects, varying in age and background are 
tested and the results are pooled. No individual rec- 
ords are presented. 


Dr. Lorge has written an important criticism on 
this point. "May I suggest that as I understand this 
piece of research, the variables are: 


Shuffle machines, versus 
dice machines; 

reward, versus 
non-reward; 

adult, versus 

child; 

individual, versus 
group. 


DWI ACL LO DO 


The design of the experimental layout could have 
been arranged in Latin-Greek squares so that various 
sources of variation could be evaluated at least tenta- 
tively. The author unfortunately through poor design 
may be making inferences come in favor of one or the 
other of his variables. I believe that individual varia- 
tion is a source of considerable ESP effect which is not 
necessarily extrasensory. I think that contingency or 
correlation methods are absolutely necessary to settle 
this issue." 


C. Statistical Method and Interpretation 


Part of the criticism in this section is con- 
tained in the preceding statements. 


Dr. Hilgard has raised the following points: 
first, "Objection may be raised to pooling raw discrep- 
ancy scores with sign reversals as in Tables I, II, III, 
and VI. The fact is clearly indicated in each case, but 
the reason given, that the result was ‘experimentally an- 
ticipated’ means in operational terms only that it was 
experimentally found. It was not even anticipated in 
terms of a prior hypothesis, although even such antici- 
pation would not justify pooling. This objection does 
not apply to Chi Square treatments, but does apply to 
summating raw discrepancies from expected mean values. 

By the same logic, all signs could be made alike, provid- 
ed only that a consistent sign was found for one stated 
circumstance of experimentation"; and second, "reitera- 
tion is needed for the warning on p. 3 of the appendix 
that the average deviation for the data from precogni- 
tion experiments, as pooled with the sign reversals, is 
only .036, so that ‘whatever is to be assumed as the ex- 
trachance factor producing the significant total 








de’ 


mel 
au’ 
tal 
fo: 
col 
Wi. 
the 
the 
ta: 
te! 
sui 
ant 


ed. 
ths 
ma 


op: 
Dr. 
fo! 
f fe 
the 
lis 


De; 
Dir 
Bre 








LETTERS TO THE EDITORS 91 





deviation, it must be operating almost at the vanishing 
point.'" 


Hilgard's first point was noted also by other 
members of the Board. Dr. Lorge "urgently requests the 
author not to advise the reader that material is unimpor- 
tant and then discuss such material or that the logic 
for an experiment is not relevant and then infer in his 
conclusions about the necessary logical steps." Dr. 
Willoughby states "we need give no special attention to 
the fact that whether the subjects (instructed to match 
the cards, we eventually find out) succeed or fail in the 
task makes no great difference, since the results are in- 
terpreted as evidence for ESP anyway. We might accept 
such reasoning if actual distributions were presented 
and shown to be V-shaped. It is impossible to accept it 
on the basis only that "it was experimentally anticipat- 
ed," that is, that Dr. Rhine thought in advance (he says) 
that it might turn out that way." The same point was 
made by Dr. Sells. 


Conclusion 


On the basis of the above criticism it is the 
opinion of the writer that the paper be referred back to 
Dr. Rhine for revision. A copy of this memorandum may be 
forwarded to him for any guidance he may wish to accept 
ffom it. In the event that it is inexpedient to revise 
the paper, it is requested that this memorandum be pub- 
lished simultaneously with it. 


Saul B. Sells, Chairman 


Department of Education 
Division of Graduate Studies 
Brooklyn College 
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To the Editors: 


I have gone over the criticisms made by the 
Board of Review on my report published in this issue, 
and I have tried to do everything reasonably possible to 
conform to what (even an individual member of) the Board 
thought it worthwhile to suggest. This has not meant, 
of course, that I have been able to see the justice of 
all the criticisms or the need for the changes made. 
Since the report covers a somewhat complicated research, 
naturally some patience is called for on the part of the 
reader if the organization is to be followed. Further, 
the demands of the great number of counter-hypotheses 
with which the ESP experimenter is now contronted re- 
quires emphasis upon completeness of reporting to a de- 
gree that suggests verbosity to the reader who does not 
have the various counter-hypotheses in mind. 


These considerations may not excuse, though they 
may qualify, the impression of wretched reporting which 
some members of the Board of Review seem to have got 
from my paper. Having been at some pains to amend the 
manuscript wherever possible to meet the criticisms, I 
trust I am not letting myself off too easily to conclude 
that after all if the report is understandable at all, 
the most important question is: Is the conclusion war- 
ranted? For this question the second and third sections 
of the report of the Board of Review are necessarily of 
consideration. 


The sections on "Design of the Experiment" and 
"Statistical Method and Interpretation" contain some 
criticisms which I am unable to comply with, in spite of 
my appreciation for the time and consideration which the 
members of the Board have given to the matter. Accord- 
ingly I think it would be best to refer the issues to 
the judgment of the reader by offering brief comments on 


the specific criticisms for publication with this letter. 


Yours very truly, 


J. B. Rhine 
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Remarks on the Criticisms Summarized under 


"Design of the Experiment" 


Under the heading "Design of the Experiment," Dr. 
Sells apparently includes both la) the question of wheth- 
er the experimental procedure is adequate for the testing 
of the hypothesis and (b) the question of whether the 
experiment lends itself satisfactorily to statistical 
analysis. 


On the former question of experimental adequacy, 
there is no serious criticism given. In view of the 
conclusions of the report, this is of the utmost impor- 
tance. As a matter of fact, Dr. Long definitely states 
that he did not observe any serious omission in the ex- 
perimental procedure. Of the two who did, one of then, 
Dr. Kennedy, made only a mild criticism. Dr. Hilgard's 
criticisms concern matters of nicety, since he himself 
uses the expression "generally satisfactory" to apply to 
the general experimental procedure. I have reviewed the 
situation because I am at a loss to understand Dr. Sells' 
interpreting Dr. Hilgard as implying "general laxity of 
procedure." 


Dr. Lorge's criticism of the design of the ex- 
periment (his impression of the lack of design, as Dr. 
Sells puts it) is dealt with adequately, I think, in the 
revision of the manuscript--particularly by the inclu- 
sion of Figure 3 representing graphically the design fol- 
lowed. From this it will be seen that the experiment is 
complex but by no means confused. 


However, in the section on "Design" there are 
several criticisms made which are statistical in charac- 
ter. Dr. Lorge suggests the use of the Latin square 
method, but I can discover no advantage which it would 
have in this research. Every square in the experimental 
design is properly evaluated--if need be, against a theo- 
retical chance background; and, for intersquare rela- 
tions, comparison and combination of critical ratios are 
feasible. For that matter the data are amenable to an 
Analysis of Variance treatment if that seems desirable. 





1. Dr. Greenwood has applied the Analysis of Variance technique to 
the experimental results under discussion. He contemplates sub- 
mitting a report on this treatment to the editors of the Journal 
with a view to acquainting ESP workers in general with the use 
of this method. This, however, is not the Latin square treat- 
ment which Dr. Lorge specifically suggested but is an outgrowth 
of his suggestion. 
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Likewise I can see no ground nor discover any mathemati- 
cal authority for Dr. Lorge's emphatic statement that 
contingency or correlation methods are absolutely neces- 
sary to settle the issue of this report. These methods 
may be, and on occasion have been, used; but not from 
absolute necessity. 


The old question of the applicability of the 
matching hypothesis is brought up again specifically by 
Dr. Willoughby and indirectly by Dr. Long (in his ques- 
tion of the independence of the twenty-five choices). I 
think it is fair, as it certainly is most economical, to 
refer this question back to where it was settled in the 
first place--by mathematicians of probability. For Dr. 
Greenwood's summary, see Chapter II, "Extra-Sensory Per- 
ception After Sixty Years." 


The two remaining questions of statistical char- 
acter raised under the heading of "Design" both lead to 
the same solution; namely, to the cross-check series. 
These are: first, Dr. Long's question whether in match- 
ing tests the number of cards matched represents the 
real number of trials or whether there is a padding ef- 
fect; and second, Dr. Willoughby's question as to whether 
the matching (sorting) techniques do not require a spe- 
cial empirical distribution of run scores in order to 
determine the type of distribution for this set of data. 
The answer is that the empirical control distributions 
(both for matching and for calling methods) available in 
the now numerous cross-check series are applicable to 
such issues as those raised. Dr. Long's problem is es- 
sentially touched upon in the section entitled "Stacking 


Etfect." (See Table II of the report for the cross- 
checks; for similar material see Table II, "Extra-Sensory 
Perception After Sixty Years;" also Miss Hutchinson's 
report in the preceding issue of this Journal.) 


Remarks on Criticisms on "Statistical 
Method and Interpretation" 


Under this heading the criticisms center upon the 
question of the statement of objectives given for the 
Adult Division. I stated simply that having got nega- 
tive deviations in two comparable introductory experi- 
mentc, I was seeking for a ~egative deviation throughout 
the four series of the Adult Division. 


Now I doubt seriously if any one of the critics 
supposes that I went through the six negative series com- 
pletely blind to consequence. Nor can he well suppose 
that I should be quite so unintelligent as to continue 
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so long steadily rolling up a large negative deviation 
while seeking for a positive one. The only reasonable 
question is as to the point where the induction that such 
a procedure would lead to a negative deviation occurred, 
and where a negative deviation was essentially predicted 
for the next series. My statement of intention, as well 
as’ the objective indications, show that this was at the 
point following Introductory Series A and B. 


But Dr. Hilgard pointed out what Drs. Sells and 
Willoughby apparently did not recognize; namely that the 
sign of deviation is not of concern in the chi square 
treatment; and it is obvious that the conclusions may 
rest upon chi square treatments alone. 


Moreover, regardless of statements of intention 
the two divisions may be treated separately by the criti- 
cal ratio method. There is no question of the legitimacy 
of this and since each division is independently signifi- 
cant by this method, there is no need to dispute the pro- 
priety of pooling the deviations with sign reversal. Ac- 
cordingly, I have deleted the data from pooling with sign 
reversals from Tables I, II, and III. (I have not done 
so for the Appendix Table VI since this table is given 
for the purpose of pooling of all totals and is intended 
to be complete. The only alternative here to pooling 
with sign reversal would be pooling without sign rever- 
sal, but this would be to assume the direct opposite of 
the actual experimental objective for the Adult Division. 
Again, however, the statistical significance of the to- 
tal results does not rest upon the point discussed.) 


The use of significant negative deviations to 
support the ESP hypothesis appears to disturb Drs. Wil- 
loughby and Sells. This matter is discussed at length 
in the later sections of the report under discussion (to 
which no reference is made by the Board). In addition 
their attention might be directed to familiar examples 
of successful avoidance responses as exhibited, for in- 
stance, in hypnotic blindness demonstrations in which the 
subject successfully avoids contact with the objects he 
is supposed not to be able to see. Obviously a card 
test under such conditions would show, not chance coin- 
Cidence, but a negative deviation from chance. The re- 
sults would presumably be construed as evidence of per- 
ception--of a kind. 
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To the Editors: 


I should appreciate the courtesy of space in the 
Journal in order to answer a charge brought against me 
by Dr. Willy Feller in his article: Statistical Aspects 
of ESP, which appeared in the December issue. 


He states, on page 287, that the validity of the 
optional stopping effect in ESP experimentation "was 
again and again vigorously denied," and then, apparently 
as an instance of such a "denial," quotes in a footnote 
@ paragraph from my paper at the ESP symposium in 1938. 
As this quotation contains no reference to the effect 
usually described by the term "optional stopping," I feel 
that he owes it to me and to his readers to explain how 
he is able to so construe it. His startling statement as 
to the probability of attaining a given success ratio al- 
so deserves to be amplified. 


The optional stopping effect generally discussed 
in connection with ESP data (and the only one considered 
by Dr. Feller in his article) is concerned with the pos- 
sibility of obtaining a high value of the so-called 
"critical ratio" by choosing a favorable stopping point. 
On the other hand, the paragraph from my paper deals with 
the probability of obtaining a given success ratio ina 
prolonged series: a situation which might be held to in- 
volve one form of "optional stopping," but is governed 
by an entirely different set of considerations. 


The quotation in question reads as follows: 


"The statement is occasionally made that by con- 
tinuing long enough one is certain eventually to obtain 
a fairly high average total score. This is clearly at 
variance with the recognized laws of probability, but in 
order to meet the objection more specifically I have 
worked out a formula which gives, with a high degree of 
accuracy, the probability that a given score will ever 
be reached in a series of infinite length....For exam- 
ple, the probability in an infinite series of calls of 
ever securing, at any time after the first 10,000 calls, 
a total average score of 5% correct ae per 25 can 
be shown to be less than one in a million." 


Immediately following the above quotation, Dr. 
Feller says: 


"In reality this probability is 1 (certainty) 
and one is certain to get, infinitely often, an arbi- 
trarily large C. R." 
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That the unambiguous wording “total average score 
of 5s correct guesses per 25" should be misunderstood by 
anyone well read in the literature of ESP is most unlike- 
ly. Yet it is equally incomprehensible that it should 
be necessary to point out to a mathematician of Dr. Fel- 
ler's standing in the field of probability the absurdity 
of the statement that there is a unit probability of ob- 
taining a success ratio greater than the probability of 
success on a single trial. That this cannot be true is 
at once apparent if we compute the C. R. necessary to 
produce an average score of 5s per 25. This is 1/50 
+ 2/5 Jn which equals Vn/20. Now, as Dr. Feller hin- 
self points out in his footnote 32, the order of magni- 
tude of the greatest observed C. R. in a series of n 
trials is expected to be /log log n, while the C. R. re- 
quired for a success ratio of 11/50 has just been shown 
to be of the order Vn, which increases much more rapid- 
ly than Vlog log n. The derivation of the precise fig- 
ure of "less than one in a million" is too technical to 
reproduce here, but follows easily from the usual formu- 
lae for the probability of the ruin of one of two gam- 
blers betting on the outcome of a series of games, where 
their probabilities of winning are constant from game to 
game (see, for example, J. VY. Uspensky, Introduction to 
Nathematical Probability, p. 146). 


It is to be hoped that Dr. Feller will explain 
in detail just what he meant by this footnote. 


T. N. E. Greville 





